-
Notifications
You must be signed in to change notification settings - Fork 29
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: added recipe for redshift-for-houdini on SMF #84
Open
yuanmich2
wants to merge
7
commits into
aws-deadline:mainline
Choose a base branch
from
yuanmich2:redshift4houdini_recipe
base: mainline
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
feat: added recipe for redshift-for-houdini on SMF #84
yuanmich2
wants to merge
7
commits into
aws-deadline:mainline
from
yuanmich2:redshift4houdini_recipe
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
149cf3b
to
ea24ca2
Compare
…line#83) Signed-off-by: Joel Wong <[email protected]> Signed-off-by: Michael Yuan <[email protected]>
Signed-off-by: Michael Yuan <[email protected]>
Signed-off-by: Michael Yuan <[email protected]>
* Update apply-conda-queue-env.py to remove trailing whitespace. * Clean up conda queue environment samples. * Create virtual environments in directories with names randomized by `mktemp`. * Capture the environment activation by using `conda run` instead of `conda activate`. Deactivate by calling eval "$(conda shell.bash deactivate)". These changes let the environment work without `conda init` changes working in non-interactive contexts. * Use Python instead of bash $(()) expressions for math. * Add `--quiet` option to `conda create` and `conda install` commands, to remove incremental progress updates from the log. * Add a `conda list` call to the 'improved_caching' env enter when it is reusing an environment, so that it is easy to look at the contents of the virtual environment from each job's log view. * Fixed a failing case in the 'improved_caching' env exit, due to grep return exit code 1 when no cached environments exist. * Update the job_dev_progression README to include specific instructions for both running the job on Deadline Cloud and running the job locally with the Open Job Description CLI. * Update the job dev progression code to use `mkdir -p` so that repeated runs on the same workspace succeed. Signed-off-by: Mark Wiebe <[email protected]> Signed-off-by: Michael Yuan <[email protected]>
This sample comes in three parts: * A CloudFormation template to deploy a CUDA Deadline Cloud farm. The deployed farm is general to any Linux CUDA workload, and an easy way to get a farm for this sample. The deployed farm includes two queues, one for package building and another for running production jobs. * A NeRF Studio conda package recipe. While NeRF Studio is an open source project, it and many of its dependencies do not have packages in the conda-forge channel. This recipe builds a package called nerfstudio that bundles together these dependencies and NeRF Studio. * A job bundle containing a 3D Gaussian Splatting pipeline. The job bundle focuses on simplicity over features, containing just one task to run the whole pipeline. Each part includes README content with instructions on how to use it, and cross-links between the different parts so that if you land on any one of them you can navigate to the others. Signed-off-by: Mark Wiebe <[email protected]> Signed-off-by: Michael Yuan <[email protected]>
Signed-off-by: Mark Wiebe <[email protected]> Signed-off-by: Michael Yuan <[email protected]>
942a710
to
93923b2
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What was the problem/requirement? (What/Why)
There was no example for Redshift on Houdini.
What was the solution? (How)
This pr adds a conda recipe for Redshift on Houdini
What is the impact of this change?
Now everyone can see an example of how to build a conda package for Redshift on Houdini
How was this change tested?
I performed some tests on my own farm
Was this change documented?
The sample comes with its own readme
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.