feat(flm): add --modelscope flag to FLM backend

[wariobot09]

Summary

Add --modelscope BOOL option to the FLM backend descriptor. When set to 1, passes --modelscope 1 to flm pull, flm list, and flm installed-checkpoints CLI calls to resolve models from ModelScope (https://modelscope.cn) instead of HuggingFace.

Changes

• fastflowlm.h: Add modelscope BOOL option to FLM backend descriptor (defaults to "0")
• fastflowlm_server.h: Add modelscope parameter to download_model() signature
• fastflowlm_server.cpp: Read modelscope option in load() and pass to download_model()
• docs/dev/backends-reference.md: Document the new modelscope option in FLM backend table
• docs/guide/cli.md: Document the new modelscope option in CLI reference

Usage

Users can enable ModelScope downloads in their config.json:

{
  "flm": {
    "args": "",
    "modelscope": 1,
    "prefer_system": false
  }
}

Note: FLM expects 0/1 (not true/false) for the --modelscope flag.

This requires FLM ≥ v0.9.46 which introduces the --modelscope flag.

[jeremyfowers]

Looks like CI found some problem? Please have a look.

I made a 1LoC PR here for the version bump, to try and get it into today's release: #2847

We will still need this PR for the modelscope support!

[superm1]

Looks like CI found some problem? Please have a look.

I made a 1LoC PR here for the version bump, to try and get it into today's release: #2847

We will still need this PR for the modelscope support!

I think Hermes messed up and passed --modelscope to flm serve. Let's see if this is clean now.

[superm1]

@jeremyfowers modelscope should be fixed now, can you have another look please?

[jeremyfowers]

omg is wariobot your bot? 😂

[jeremyfowers]

[AI-assisted review] Automated pre-review from repo-manager — flags for the human reviewer, not a replacement for one.

Attention level: Elevated — any reviewer can take it, but the to-dos below need resolving before approval (PR description does not match the diff)

Author's description vs. the diff

The description overstates the scope of changes and references a file that was not modified.

• Remove the reference to docs/guide/configuration/README.md from the PR description, or add the config README update to the PR.
  • Described: docs/guide/configuration/README.md is updated with modelscope in the config example JSON and FLM options table.
  • In the diff: docs/guide/configuration/README.md is not among the five changed files in the diff.
  • Reference: The PR description lists docs/guide/configuration/README.md under the Documentation section, but the file list shows only docs/dev/backends-reference.md, docs/guide/cli.md, and three C++ files.
• Update the PR description to remove the claim that --modelscope is passed to flm serve.
  • Described: The --modelscope flag is passed to both flm pull and flm serve commands.
  • In the diff: The flag is only passed to download_model(), which is used for flm pull; no code in the diff passes --modelscope to the flm serve path.
  • Reference: fastflowlm_server.cpp adds --modelscope to args only inside the download_model() function; the load() function calls download_model() but does not pass --modelscope to the serve command.

Scope

minor — The PR adds a single BOOL option to the existing FLM backend descriptor with 16 lines of additions across 5 files — a contained extension of an existing surface.

Suggested reviewers

• bitgamma (CLI) — The PR adds a CLI flag and updates docs/guide/cli.md.
• jeremyfowers (Adding new backends) — The PR modifies the FLM backend descriptor and server implementation.
• ramkrishna2910 (Adding new backends) — The PR adds a backend option to the FastFlowLM backend.

Reviewed at head 919d813 by repo-manager pr-review. Regenerate with repo-manager review-pr 2841.

[jeremyfowers]

see bot review