Skip to content

setup: keep flat-model vision files inside the models directory - #973

Open
mercant1982 wants to merge 1 commit into
mw00:mainfrom
mercant1982:fix/setup-flat-model-vision
Open

mercant1982 wants to merge 1 commit into
mw00:mainfrom
mercant1982:fix/setup-flat-model-vision

Conversation

@mercant1982

Copy link
Copy Markdown

Fixes #972.

When an existing GGUF pack is directly inside --models-dir, the setup currently chooses the model directory's parent for its shared vision folder. For --models-dir /data3 with a retained /data3/maya-ds4 pack, that means /vision.

This change keeps vision inside the configured models directory for that flat layout. The normal nested quant layout keeps its shared sibling vision folder. The initial pack, vision setup and subsequent repack receive the same selected path; EXL3 behavior is unchanged.

CPU before/after on Linux x86_64, base c5842c5:

  • Both new regression tests fail on the unchanged setup and pass with the fix.
  • python3 -m unittest tools.test_setup_ds4: 89 passed.
  • git diff --check: passed.

The regression uses temporary directories and mocked external build/download boundaries. It exercises the real setup path selection and the pack command's --vision argument. No model weights, network request, GPU or production configuration were used or changed. This is a setup-path correction, not a serving or performance change.

Evidence: MAYA972.json; maya972-vision-path.patch.

Reproduction instructions · Evidence bundle and licenses.

Fixes mw00#972

Assisted-by: Codex
Signed-off-by: Manuel Stehle <338640100+mercant1982@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

If model dir is on separate disk as /data3 , vision download will default to root / dir

1 participant