Skip to content

Issues: ModelTC/lightllm

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
31 Open 70 Closed
31 Open 70 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[BUG]通过 zmq.Socket.recv_pyobj 进行的隐式 Pickle 反序列化导致远程代码执行 (RCE) bug Something isn't working
#784 opened Mar 28, 2025 by kexinoh
2
[Feature]支持多机的tp或者dp吗 bug Something isn't working
#739 opened Feb 19, 2025 by zpllz
2
[BUG] cannot launch server after builting from source bug Something isn't working
#679 opened Dec 24, 2024 by MisterBrookT
2
支持encoder-only模型 bug Something isn't working
#573 opened Oct 20, 2024 by EvanSong77
1
请支持minicpmv2.5 bug Something isn't working
#482 opened Aug 1, 2024 by LDLINGLINGLING
3
question about fp8 version of context_flashattention_nopad.py bug Something isn't working
#479 opened Jul 30, 2024 by changyuanzhangchina
2
from lightllm_ppl_int8kv_flashdecoding_kernel import group8_int8kv_flashdecoding_stage1 bug Something isn't working
#475 opened Jul 24, 2024 by AlvL1225
有不通过http的其他推理入口吗 bug Something isn't working
#466 opened Jul 15, 2024 by mmdbhs
2
[Feature]: Suport for InternVL-Chat-V1-5 bug Something isn't working
#462 opened Jul 10, 2024 by JingofXin
1
Add Support to Florence-2 ! bug Something isn't working
#456 opened Jul 5, 2024 by KaifAhmad1
1
[BUG]Ask aboout Qwen models with weight quantization . bug Something isn't working
#408 opened May 15, 2024 by Cesilina
1 task
2
[BUG] There already is a lightllm in pypi bug Something isn't working
#380 opened Mar 26, 2024 by rlippmann
1 task
Qwen-14B-INT8 face the issue: 'QwenTransformerLayerWeight' object has no attribute 'q_weight_' bug Something isn't working
#333 opened Feb 20, 2024 by wangr0031
2
[BUG] stop_words bug Something isn't working
#326 opened Feb 2, 2024 by baisechundu
[BUG] Support for DeepSeek? bug Something isn't working
#325 opened Feb 2, 2024 by suhjohn
1
Inconsistent Output between LightLLM and Transformers Inference Library bug Something isn't working
#309 opened Jan 19, 2024 by Lvjinhong
2
请问lightllm可以离线推理吗，有没有参考代码 bug Something isn't working
#308 opened Jan 19, 2024 by monkeyZhy
1 task
1
[BUG] Qwen-7B-Chat AttributeError: 'LlamaSplitFuseInferStateInfo' object has no attribute 'logn_values' bug Something isn't working
#239 opened Dec 2, 2023 by exceedzhang
1 task
4
no attribute 'qkv_weight_' AttributeError when load Qwen-14B-Chat-Int4 bug Something isn't working
#234 opened Dec 1, 2023 by jarviszeng-zjc
8
[BUG] Assertation error self.config["num_attention_heads"] % self.world_size_ == 0 when not perfectly divisible bug Something isn't working
#233 opened Nov 30, 2023 by getorca
1
[BUG] triton 2.0.0.dev20221202 has a memory leak bug, and fix way. bug Something isn't working
#209 opened Nov 13, 2023 by hiworldwzj
高并发输出不稳定 bug Something isn't working enhancement New feature or request
#203 opened Nov 10, 2023 by GavinZhao19
4
源码复现过程中出现很多问题 bug Something isn't working
#187 opened Nov 1, 2023 by lxnlxnlxnlxnlxn
4
out of memory bug Something isn't working
#171 opened Oct 20, 2023 by enhaofrank
3
[BUG]baichuan-13b-error bug Something isn't working
#156 opened Sep 28, 2023 by kuangdao
2
ProTip! Follow long discussions with comments:>50.