Skip to content

Prototype Apple container sidecar torch frontend#144

Merged
kevmo314 merged 1 commit into
mainfrom
prototype/apple-container-remote
Jun 2, 2026
Merged

Prototype Apple container sidecar torch frontend#144
kevmo314 merged 1 commit into
mainfrom
prototype/apple-container-remote

Conversation

@kevmo314

@kevmo314 kevmo314 commented May 28, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • add a session-scoped lupine.sidecar(...) frontend that launches a Linux/arm64 PyTorch worker through Apple container on macOS
  • add a custom CUDA PyTorch worker image that bundles the LUPINE libcuda/NVML shims
  • add preflight handling for Apple container services, missing images, and missing container installs
  • forward factory and tensor ops through a session-scoped TorchDispatchMode instead of per-op Python boilerplate

Validation

  • uv run pytest
  • uv run --python 3.13 --with pytest --with torch --with numpy --with-editable ./python pytest -q python/tests/test_lupine_adapter.py
  • built and cached lupine-pytorch-worker:cuda-13.1.0 with Apple container
  • proved native macOS Python frontend returns [0.0, 2.0, 4.0, 6.0, 8.0, 10.0, 12.0, 14.0] through sidecar CUDA PyTorch on an RTX 4090

Notes

This is intentionally a prototype backend. It proves the local macOS frontend plus Linux sidecar approach, but there are still CUDA backend limitations outside the Python forwarding layer.

@kevmo314 kevmo314 force-pushed the prototype/apple-container-remote branch 3 times, most recently from 2714624 to b7bfe52 Compare June 2, 2026 02:32
@kevmo314 kevmo314 changed the title Prototype Apple container remote torch frontend Prototype Apple container sidecar torch frontend Jun 2, 2026
@kevmo314 kevmo314 force-pushed the prototype/apple-container-remote branch from b7bfe52 to 5cda063 Compare June 2, 2026 02:42
@kevmo314 kevmo314 force-pushed the prototype/apple-container-remote branch from 5cda063 to f02a651 Compare June 2, 2026 02:47
@kevmo314 kevmo314 merged commit a6f01ac into main Jun 2, 2026
55 of 57 checks passed
@kevmo314 kevmo314 deleted the prototype/apple-container-remote branch June 2, 2026 03:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant