Merge branch 'main' into fix/simplify-publish-dialog-version-names

Author: deep1401

.agents/skills/transformerlab-cli/SKILL.md

@@ -87,7 +87,9 @@ lab task list
 # 3. Queue a task on a compute provider
 #    NOTE: --no-interactive silently picks the DEFAULT provider (Local).
 #    To pick a specific provider, run interactively (see "Selecting a provider" below).
-lab task queue TASK_ID --no-interactive
+#    ALWAYS pass --description/-m with a markdown note describing the iteration
+#    (see "Always write a run description" below).
+lab task queue TASK_ID --no-interactive -m "Testing lr=3e-5 after loss plateaued at 2.1"
 
 # 4. Monitor the job (three log streams — see "Job logs: three real commands" below)
 lab job list --running
@@ -226,6 +228,37 @@ lab task add ./hello-world-task --no-interactive
 10. **Never use the deprecated `lab job logs`** — see the "Job logs: three real commands" section below.
 11. **After queuing a task, ASK the user if they'd like you to watch the logs.** Don't start streaming or polling automatically — jobs can take minutes to hours, and `--follow` blocks. Report the Job ID and ask: "Want me to watch the logs and report back?"
 12. **Never create API keys programmatically** — if auth fails, ask the user to provide an API key from the web UI
+13. **Always pass `--description/-m` when queuing a task. Generate it yourself — never ask the user.** See "Always write a run description" below.
+
+### Always write a run description
+
+Every `lab task queue` call MUST include `--description/-m "..."`. The description is markdown stored on the job and shown in `lab job info`. Its audience is a future researcher reading `lab job list` weeks later — they have git and the task code, but NOT this chat. The description is the only bridge.
+
+**Treat it like a short PR description for this run.** Draft 1–5 lines (bullets for multi-point notes) covering:
+
+1. **What changed vs the prior run / baseline** — the concrete diff (hyperparameters, code, model, data, infra). If nothing changed, say so and link the prior job.
+2. **What hypothesis you're testing** — why this run is worth doing.
+3. **What a future reader should remember** — gotchas, prior surprises, things to check in the output.
+
+Pull these from the conversation and recent git diff / edited files. If the note has newlines or shell-awkward characters, pipe it: `printf '%s' "$DESC" | lab task queue abc123 -m -`.
+
+```bash
+# Good: diff + hypothesis + watch
+printf '%s' "- Bumped lr 1e-5 → 3e-5, warmup 100 → 500 steps.
+- Testing whether higher lr clears the eval/loss=2.1 plateau seen in job 7f21 around step 2k.
+- Watch: earlier runs with lr≥5e-5 diverged by step 500." | lab task queue abc123 --no-interactive -m -
+
+# Good: small change — one line is enough
+lab task queue abc123 --no-interactive -m "Rerun on H100 (was A100) to confirm throughput regression from #1850."
+
+# Good: nothing changed
+lab task queue abc123 --no-interactive -m "Rerun of job 7f21, no code or config changes (network flake on first attempt)."
+
+# Bad: generic filler that tells the reader nothing
+lab task queue abc123 -m "train model"
+```
+
+Don't restate the task name, full hyperparameter dict, or file paths — those are already on the job record. Don't copy the user's last message verbatim — synthesize. If the conversation is truly empty of signal, fall back to `"Rerun of <id>, no changes"`.
 
 ### Selecting a provider when queuing a task
 
@@ -308,7 +341,7 @@ This applies to launching jobs, fetching logs, checking cluster status, and ever
 | `lab task init` | Scaffold `task.yaml` + `main.py` in the current directory (`--interactive` to prompt) | No |
 | `lab task add [dir]` | Add task from directory or `--from-git` URL (`--no-interactive`, `--dry-run`) | Yes |
 | `lab task delete <id>` | Delete a task (`--no-interactive` to skip confirmation) | Yes |
-| `lab task queue <id>` | Queue task on compute provider | Yes |
+| `lab task queue <id>` | Queue task on compute provider (`-m/--description` for a markdown run note; required for agents, see "Always write a run description") | Yes |
 | `lab task gallery` | Browse/import from task gallery | Yes |
 | `lab job list` | List jobs (`--running` for active only) | Yes |
 | `lab job info <id>` | Get detailed job information | Yes |

.agents/skills/transformerlab-cli/references/commands.md

@@ -131,6 +131,7 @@ Queue a task on a compute provider.
 | Option | Description |
 |---|---|
 | `--no-interactive` | Skip prompts. Uses the task's configured provider or first available. Parameters use defaults. **Always use this in automated workflows.** |
+| `-m`, `--description <text>` | Markdown note describing what this run is trying to accomplish (stored on the job, shown in `lab job info`). Pass `-` to read from stdin. **Agents: required per SKILL.md rule 13.** |
 
 **JSON output:** Returns the created job object with `id` and `status`.
 

.github/workflows/gallery-channel-bundles.yml

@@ -0,0 +1,53 @@
+name: Gallery Channel Bundles
+
+on:
+  pull_request:
+    branches: ["main"]
+    paths:
+      - "api/transformerlab/galleries/src/**"
+      - "api/transformerlab/galleries/combine_subset_galleries.py"
+  push:
+    branches: ["main"]
+    paths:
+      - "api/transformerlab/galleries/src/**"
+      - "api/transformerlab/galleries/combine_subset_galleries.py"
+
+jobs:
+  verify-bundle-updated:
+    runs-on: ubuntu-latest
+    defaults:
+      run:
+        working-directory: api
+    steps:
+      - uses: actions/checkout@v4
+        with:
+          fetch-depth: 0
+      - name: Set up Python 3.11
+        uses: actions/setup-python@v5
+        with:
+          python-version: "3.11"
+      - name: Require stable/beta bundle update for source changes
+        shell: bash
+        run: |
+          if [ "${{ github.event_name }}" = "pull_request" ]; then
+            BASE_SHA="${{ github.event.pull_request.base.sha }}"
+            HEAD_SHA="${{ github.event.pull_request.head.sha }}"
+          else
+            BASE_SHA="${{ github.event.before }}"
+            HEAD_SHA="${{ github.sha }}"
+          fi
+
+          CHANGED="$(git diff --name-only "${BASE_SHA}" "${HEAD_SHA}")"
+          echo "Changed files between ${BASE_SHA} and ${HEAD_SHA}:"
+          printf '%s\n' "${CHANGED}"
+
+          if printf '%s\n' "${CHANGED}" | grep -E '^api/transformerlab/galleries/channels/(stable|beta)/latest/' > /dev/null; then
+            echo "Bundle update detected under stable/beta latest."
+            exit 0
+          fi
+
+          echo "ERROR: galleries/src changed, but no stable/beta bundle update was committed."
+          echo "Update either:"
+          echo " - api/transformerlab/galleries/channels/stable/latest/*"
+          echo " - api/transformerlab/galleries/channels/beta/latest/*"
+          exit 1

.gitignore

@@ -227,3 +227,4 @@ test-results/
 **/.secrets
 
 docs/superpowers/*
+.superpowers/

api/api.py

@@ -55,7 +55,6 @@
 
 
 from transformerlab.routers.experiment import experiment  # noqa: E402
-from transformerlab.routers.experiment import jobs  # noqa: E402
 from transformerlab.shared import shared  # noqa: E402
 from transformerlab.shared import dirs  # noqa: E402
 from lab.dirs import set_organization_id as lab_set_org_id  # noqa: E402
@@ -306,7 +305,6 @@ async def validation_exception_handler(request, exc):
 app.include_router(serverinfo.router, dependencies=[Depends(get_user_and_team)])
 app.include_router(data.router, dependencies=[Depends(get_user_and_team)])
 app.include_router(experiment.router, dependencies=[Depends(get_user_and_team)])
-app.include_router(jobs.router, dependencies=[Depends(get_user_and_team)])
 app.include_router(config.router, dependencies=[Depends(get_user_and_team)])
 app.include_router(teams.router, dependencies=[Depends(get_user_and_team)])
 app.include_router(compute_provider.router)

api/localprovider_pyproject.toml

@@ -32,7 +32,7 @@ dependencies = [
   "soundfile==0.13.1",
   "tensorboardX==2.6.2.2",
   "timm==1.0.15",
-  "transformerlab==0.1.22",
+  "transformerlab==0.1.24",
   "transformerlab-inference==0.2.52",
   "transformers==4.57.1",
   "wandb==0.23.1",

api/pyproject.toml

@@ -24,7 +24,7 @@ dependencies = [
   "python-dotenv==1.1.0",
   "python-multipart==0.0.20",
   "sqlalchemy[asyncio]==2.0.40",
-  "transformerlab==0.1.23",
+  "transformerlab==0.1.24",
   "transformerlab-inference==0.2.52",
   "uvicorn==0.35.0",
   "watchfiles==1.0.5",

api/test/api/test_storage_probe_service.py

@@ -0,0 +1,71 @@
+import pytest
+from unittest.mock import AsyncMock, MagicMock, patch
+
+
+@pytest.mark.asyncio
+async def test_check_storage_probe_found():
+    """check_storage_probe returns found=True when sentinel file exists."""
+    with patch("transformerlab.services.compute_provider.storage_probe_service.set_organization_id") as mock_set_org:
+        with patch(
+            "transformerlab.services.compute_provider.storage_probe_service.get_workspace_dir",
+            new=AsyncMock(return_value="/mnt/nfs/orgs/team1/workspace"),
+        ):
+            with patch("transformerlab.services.compute_provider.storage_probe_service.storage") as mock_storage:
+                mock_storage.join = lambda *parts: "/".join(parts)
+                mock_storage.exists = AsyncMock(return_value=True)
+
+                from transformerlab.services.compute_provider.storage_probe_service import check_storage_probe
+
+                result = await check_storage_probe(job_id="job-123", team_id="team1")
+
+    assert result["found"] is True
+    assert "storage-probe-job-123.txt" in result["path"]
+    mock_set_org.assert_any_call("team1")
+    mock_set_org.assert_any_call(None)
+
+
+@pytest.mark.asyncio
+async def test_check_storage_probe_not_found():
+    """check_storage_probe returns found=False when sentinel file is missing."""
+    with patch("transformerlab.services.compute_provider.storage_probe_service.set_organization_id"):
+        with patch(
+            "transformerlab.services.compute_provider.storage_probe_service.get_workspace_dir",
+            new=AsyncMock(return_value="/mnt/nfs/orgs/team1/workspace"),
+        ):
+            with patch("transformerlab.services.compute_provider.storage_probe_service.storage") as mock_storage:
+                mock_storage.join = lambda *parts: "/".join(parts)
+                mock_storage.exists = AsyncMock(return_value=False)
+
+                from transformerlab.services.compute_provider.storage_probe_service import check_storage_probe
+
+                result = await check_storage_probe(job_id="job-999", team_id="team1")
+
+    assert result["found"] is False
+
+
+@pytest.mark.asyncio
+async def test_launch_storage_probe_returns_job_id():
+    """launch_storage_probe calls launch_template_on_provider and returns job_id."""
+    mock_launch = AsyncMock(return_value={"job_id": 42, "status": "success"})
+
+    with patch(
+        "transformerlab.services.compute_provider.storage_probe_service.launch_template_on_provider",
+        new=mock_launch,
+    ):
+        from transformerlab.services.compute_provider.storage_probe_service import launch_storage_probe
+
+        user_and_team = {"team_id": "team1", "user": MagicMock(id="user1", first_name="", last_name="", email="")}
+        result = await launch_storage_probe(
+            provider_id="prov-1",
+            user_and_team=user_and_team,
+            session=MagicMock(),
+        )
+
+    assert result["job_id"] == 42
+    assert result["experiment_id"] == "__storage_probe__"
+    call_args = mock_launch.call_args
+    request = call_args.kwargs["request"]
+    assert request.run == "python -m lab.probe"
+    assert request.experiment_id == "__storage_probe__"
+    assert request.cpus == "1"
+    assert request.accelerators is None

api/test/shared/test_galleries.py

@@ -0,0 +1,38 @@
+from transformerlab.shared import galleries
+
+
+def test_channel_manifests_reject_too_new_min_version():
+    manifest = {
+        "channel": "stable",
+        "min_supported_app_version": "0.30.0",
+    }
+
+    assert galleries.is_manifest_version_compatible(manifest, "0.27.0") is False
+
+
+def test_channel_manifests_accept_matching_version_range():
+    manifest = {
+        "channel": "stable",
+        "min_supported_app_version": "0.20.0",
+        "max_supported_app_version": "0.29.0",
+    }
+
+    assert galleries.is_manifest_version_compatible(manifest, "0.27.0") is True
+
+
+def test_only_selected_galleries_use_channel_fetch():
+    assert galleries.should_use_channel_bundle(galleries.TASKS_GALLERY_FILE) is True
+    assert galleries.should_use_channel_bundle(galleries.INTERACTIVE_GALLERY_FILE) is True
+    assert galleries.should_use_channel_bundle(galleries.ANNOUNCEMENTS_GALLERY_FILE) is True
+    assert galleries.should_use_channel_bundle(galleries.TEAM_TASKS_GALLERY_FILE) is False
+
+
+def test_local_channel_path_uses_selected_channel(monkeypatch, tmp_path):
+    monkeypatch.setattr(galleries.dirs, "GALLERIES_LOCAL_FALLBACK_DIR", str(tmp_path))
+    monkeypatch.setenv("TLAB_GALLERY_CHANNEL", "beta")
+    channel_file = tmp_path / "channels" / "beta" / "latest" / galleries.TASKS_GALLERY_FILE
+    channel_file.parent.mkdir(parents=True, exist_ok=True)
+    channel_file.write_text("[]", encoding="utf-8")
+
+    resolved = galleries.get_local_gallery_path(galleries.TASKS_GALLERY_FILE)
+    assert resolved.endswith("channels/beta/latest/task-gallery.json")