Skip to content

README.md

Latest commit

 

History

History
81 lines (53 loc) · 3.33 KB

README.md

File metadata and controls

81 lines (53 loc) · 3.33 KB

Isaac Sim: Livestreaming Client

This example demonstrates how to run NVIDIA Isaac Sim on OSMO with livestream capabilities. NVIDIA Isaac Sim is an application built on NVIDIA Omniverse that enables developers to develop, simulate, and test AI-driven robots in physically-based virtual environments.

OSMO supports running Isaac Sim in a cloud environment with livestream clients enabled by port forwarding, allowing you to interact with Isaac Sim remotely through a streaming client.

Prerequisites

  • Access to an OSMO cluster with RTX GPU resources and supported GPU driver version (check system requirements)
  • Isaac Sim livestream client installed on your local machine (Installation Guide)

Checking Available Resources

Isaac Sim requires an RTX GPU with a supported driver version. To check available resources in OSMO:

osmo resource list

Depending on your use cases, you may need to increase CPU, memory, and disk resources accordingly.

Running this workflow

curl -O https://raw.githubusercontent.com/NVIDIA/OSMO/main/cookbook/integration_and_tools/isaacsim/sim.yaml
osmo workflow submit sim.yaml

Note that this workflow will run for 2 hours.

Accessing Isaac Sim

Once the workflow is running, it can take a few minutes for Isaac Sim to load. Make sure the streaming service is up by checking the workflow logs for this line:

Isaac Sim Full Streaming App is loaded.

After the streaming service is up, forward the ports to your local machine. The following ports need to be forwarded: TCP/UDP 47995-48012, TCP/UDP 49000-49007, and TCP 49100.

Run these commands in two separate terminals:

# Terminal 1: TCP ports
osmo workflow port-forward <workflow-id> stream --port 47995-48012,49000-49007,49100 --connect-timeout 300
# Terminal 2: UDP ports
osmo workflow port-forward <workflow-id> stream --port 47995-48012,49000-49007 --udp --connect-timeout 300

Wait several seconds for the ports to be forwarded, then you can access Isaac Sim in the streaming client on your local machine.

Isaac Sim Streaming Client

Important Notes

  • Each Isaac Sim instance can only connect to one Streaming Client. Connecting to an Isaac Sim instance that is currently serving a Streaming Client will result in an error for the second user.
  • When closing clients, please shutdown all port-forward commands to ensure connections are properly cleaned up.
  • Lower resolution results in less latency for better streaming performance.

Isaac Sim Display