FEAT & FIX: Added LLAMA-CPP and fixed SyntaxError problem. #773

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

kemalcanbora wants to merge 3 commits into QwenLM:main from kemalcanbora:main

+174 −1

kemalcanbora commented Jan 30, 2026

Fix: Resolve SyntaxError caused by invalid f-string with unquoted square-bracket expression

Feat: Add llama_cpp backend using llama-cpp-python bindings

Register LlamaCpp class as 'llama_cpp' model type
Support both local .gguf files and Hugging Face repo_id + filename
Implement streaming and non-streaming chat methods
Add basic message conversion compatible with qwen_agent format
Include common llama.cpp parameters (n_ctx, n_gpu_layers, n_threads, etc.)
Follow patterns from existing Transformers backend

kemalcanbora added 3 commits

January 30, 2026 13:12


          feat: Added llama_cpp

856c778


          fix: {list(config['mcpServers'].keys())}') SyntaxError: f-string: unm…

da934ab

…atched '['


          Merge branch 'main' into main

36ecbc7

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet