Discussions

• 1 You must be logged in to vote

  📣

  v1.0.1

  shihaobai announced Mar 3, 2025 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  LightLLM v1.0.0 Release!

  shihaobai announced Feb 18, 2025 in Announcements

  

  

  0
• 1 You must be logged in to vote

  📣

  LightLLM v1.0.0 Release!

  shihaobai announced Feb 18, 2025 in Announcements

  

  

  0
• 5 You must be logged in to vote

  💬

  litellm.exceptions.APIConnectionError: {"detail":"Not Found"} when trying to call completion

  techybolek started Dec 3, 2023 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  What parameters required for using quantized llama2 models?

  suhjohn asked Sep 22, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  ROCm support

  ehartford asked Sep 16, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  [Query] 请问lightllm支持llama2模型的多batch推理吗？

  ChristineSeven asked Sep 6, 2023 in Q&A · Unanswered

  

  

  0