Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: added recipe for redshift-for-houdini on SMF #84

Open
wants to merge 7 commits into
base: mainline
Choose a base branch
from

Conversation

yuanmich2
Copy link

What was the problem/requirement? (What/Why)

There was no example for Redshift on Houdini.

What was the solution? (How)

This pr adds a conda recipe for Redshift on Houdini

What is the impact of this change?

Now everyone can see an example of how to build a conda package for Redshift on Houdini

How was this change tested?

I performed some tests on my own farm

Was this change documented?

The sample comes with its own readme


By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@yuanmich2 yuanmich2 requested a review from a team as a code owner February 25, 2025 02:33
@yuanmich2 yuanmich2 force-pushed the redshift4houdini_recipe branch from 149cf3b to ea24ca2 Compare February 25, 2025 02:35
joel-wong-aws and others added 6 commits March 24, 2025 13:07
* Update apply-conda-queue-env.py to remove trailing whitespace.
* Clean up conda queue environment samples.
    * Create virtual environments in directories with names randomized
      by `mktemp`.
    * Capture the environment activation by using `conda run` instead of
      `conda activate`. Deactivate by calling eval "$(conda shell.bash deactivate)".
      These changes let the environment work without `conda init`
      changes working in non-interactive contexts.
    * Use Python instead of bash $(()) expressions for math.
    * Add `--quiet` option to `conda create` and `conda install`
      commands, to remove incremental progress updates from the log.
    * Add a `conda list` call to the 'improved_caching' env enter when
      it is reusing an environment, so that it is easy to look at the
      contents of the virtual environment from each job's log view.
    * Fixed a failing case in the 'improved_caching' env exit, due to
      grep return exit code 1 when no cached environments exist.
* Update the job_dev_progression README to include specific instructions
  for both running the job on Deadline Cloud and running the job locally
  with the Open Job Description CLI.
* Update the job dev progression code to use `mkdir -p` so that repeated
  runs on the same workspace succeed.

Signed-off-by: Mark Wiebe <[email protected]>
Signed-off-by: Michael Yuan <[email protected]>
This sample comes in three parts:
* A CloudFormation template to deploy a CUDA Deadline Cloud farm. The
  deployed farm is general to any Linux CUDA workload, and an easy way
  to get a farm for this sample. The deployed farm includes two queues,
  one for package building and another for running production jobs.
* A NeRF Studio conda package recipe. While NeRF Studio is an open
  source project, it and many of its dependencies do not have packages in
  the conda-forge channel. This recipe builds a package called
  nerfstudio that bundles together these dependencies and NeRF Studio.
* A job bundle containing a 3D Gaussian Splatting pipeline. The job
  bundle focuses on simplicity over features, containing just one task
  to run the whole pipeline.

Each part includes README content with instructions on how to use it,
and cross-links between the different parts so that if you land on any
one of them you can navigate to the others.

Signed-off-by: Mark Wiebe <[email protected]>
Signed-off-by: Michael Yuan <[email protected]>
@yuanmich2 yuanmich2 force-pushed the redshift4houdini_recipe branch from 942a710 to 93923b2 Compare March 24, 2025 20:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants