NVIDIA Spatial Intelligence Lab (SIL)

All

98 repositories

vipe
Public
ViPE: Video Pose Engine for Geometric 3D Perception
camera slam 3d depth-estimation
Python
•
Other
•121•1.6k•14•1•Updated Dec 9, 2025Dec 9, 2025
Cosmos-Drive-Dreams
Public
Cosmos-Drive-Dreams: Scalable Synthetic Driving Data Generation with World Foundation Models
generation autonomous-driving video-generation
Jupyter Notebook
•
Apache License 2.0
•49•391•21•0•Updated Dec 8, 2025Dec 8, 2025
ASE
Public
Adversarial skill embeddings for training reusable controllers for physically simulated characters.
reinforcement-learning animation physics-simulation
Python
•
Other
•154•1k•43•0•Updated Dec 7, 2025Dec 7, 2025
vid2player3d
Public
Official implementation for SIGGRAPH 2023 paper "Learning Physically Simulated Tennis Skills from Broadcast Videos"
reinforcement-learning imitation-learning character-animation
Python
•
Other
•30•293•5•0•Updated Dec 5, 2025Dec 5, 2025
MvDeCor
Public
Python
•
Other
•4•14•1•0•Updated Nov 28, 2025Nov 28, 2025
fed-sim
Public
Federated Simulation for Medical Imaging (MICCAI2020)
simulation medical-imaging generative-model miccai-2020
1•10•1•0•Updated Nov 28, 2025Nov 28, 2025
Fixer
Public
Official Repository for the NVIDIA Fixer model
Python
•
Apache License 2.0
•3•47•1•0•Updated Nov 25, 2025Nov 25, 2025
nv-tlabs.github.io
Public
The prior NVIDIA Toronto AI Lab public website, now renamed to the Spatial Intelligence Lab (SIL) and redirecting there.
sil toronto-ai-lab spatial-intelligence-lab
HTML
•0•1•0•2•Updated Nov 21, 2025Nov 21, 2025
unicon
Public
HTML
•1•1•0•0•Updated Nov 21, 2025Nov 21, 2025
ChronoEdit
Public
ChronoEdit: Towards Temporal Reasoning for Image Editing and World Simulation
image-editing image-generation video-generation aigc
Python
•
Apache License 2.0
•37•638•10•1•Updated Nov 20, 2025Nov 20, 2025
3dgrut
Public
Ray tracing and hybrid rasterization of Gaussian particles
computer-vision ray-tracing 3d-reconstruction gaussian-splatting
Python
•
Apache License 2.0
•170•1.8k•53•8•Updated Oct 20, 2025Oct 20, 2025
SCube
Public
[NeurIPS 2024] SCube: Instant Large-Scale Scene Reconstruction using VoxSplats
voxel 3d-reconstruction diffusion-models gaussian-splatting sparse-view
Python
•
Other
•23•512•14•0•Updated Oct 14, 2025Oct 14, 2025
cosmos-transfer1-diffusion-renderer
Public
Cosmos-Transfer1-DiffusionRenderer: High-quality video de-lighting and re-lighting based on Cosmos video diffusion framework
relighting genai videodiffusion
Jupyter Notebook
•
Apache License 2.0
•56•757•14•2•Updated Oct 2, 2025Oct 2, 2025
lyra
Public
Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation
video 3d diffusion gaussians
Python
•
Apache License 2.0
•36•662•2•1•Updated Oct 2, 2025Oct 2, 2025
NKSR
Public
[CVPR 2023 Highlight] Neural Kernel Surface Reconstruction
computer-vision graphics point-cloud 3d-reconstruction neural-kernel
Cuda
•
Other
•66•904•37•0•Updated Sep 24, 2025Sep 24, 2025
GEN3C
Public
[CVPR 2025 Highlight] GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Control
camera-control 3d-graphics video-diffusion-model
Jupyter Notebook
•
Apache License 2.0
•65•1.2k•30•0•Updated Sep 24, 2025Sep 24, 2025
PartField
Public
[ICCV 2025] PartField: Learning 3D Feature Fields for Part Segmentation and Beyond
open-world 3d feature-learning part-segmentation
Python
•
Other
•29•366•12•0•Updated Jul 16, 2025Jul 16, 2025
XCube
Public
[CVPR 2024 Highlight] XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchies
computer-vision graphics voxel 3d-generation generative-ai
Python
•
Other
•37•522•18•1•Updated Jun 30, 2025Jun 30, 2025
Difix3D
Public
[CVPR 2025 Oral & Best Paper Finalist] Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Models
nerf 3d diffusion-models gaussian-splatting
Python
•
Other
•77•986•38•1•Updated Jun 28, 2025Jun 28, 2025
InfiniCube
Public
[ICCV 2025] InfiniCube: Unbounded and Controllable Dynamic 3D Driving Scene Generation with World-Guided Video Models
3d video-models generative-ai
1•92•2•0•Updated Jun 27, 2025Jun 27, 2025
diffusion-renderer
Public
[CVPR'25 Oral] Official implementation for "DiffusionRenderer: Neural Inverse and Forward Rendering with Video Diffusion Models"
cvpr relighting genai delighting
Python
•
Other
•19•320•4•0•Updated Jun 13, 2025Jun 13, 2025
cosmos-av-sample-toolkits
Public archive
Cosmos-Transfer1-7B-Sample-AV Toolkits
nvidia cosmos
Python
•5•45•3•0•Updated Jun 11, 2025Jun 11, 2025
stochastic-preconditioning-website
Public
Stochastic Preconditiong for Neural Field Optimization -- additional website assets
optimization neural-fields spatial-ai
0•1•0•0•Updated May 25, 2025May 25, 2025
FlexiCubes
Public
Python
•
Apache License 2.0
•52•795•19•1•Updated Apr 4, 2025Apr 4, 2025
LLaMA-Mesh
Public
Unifying 3D Mesh Generation with Language Models
mesh-generation 3d-generation multimodal llm
Python
•
Other
•74•1.1k•21•3•Updated Mar 28, 2025Mar 28, 2025
brushstroke_engine
Public
Code accompanying Neural Brushstroke Engine paper, SIGGRAPH Asia 2022
gan unsupervised-learning research-paper siggraph digital-media interactive-ui creativity-tool generative-ai
Jupyter Notebook
•
Other
•6•31•0•0•Updated Mar 19, 2025Mar 19, 2025
GEN3C_website
Public
HTML
•0•0•0•0•Updated Mar 6, 2025Mar 6, 2025
spacemesh_website
Public
HTML
•0•1•0•0•Updated Feb 11, 2025Feb 11, 2025
ReMatchingDynamicReconstructionFlow
Public
Implementation of ReMatching Dynamic Reconstruction Flow (ICLR 2025) for augmenting dynamic scene reconstruction methods with designed velocity-field priors.
Python
•
Other
•2•13•0•0•Updated Feb 10, 2025Feb 10, 2025
ReMatching
Public
Assets of ReMatching Dynamic Reconstruction Flow (ICLR 2025)
0•0•0•0•Updated Feb 7, 2025Feb 7, 2025