[BUG]

[donghajang213]

I'm trying to use the VLLM model for an LLM, but it's encountering an error where it can't provide answers to questions. How do I resolve this??

[earayu]

Hi! Thanks for reporting this issue with the VLLM model not being able to answer questions.
To help us better assist you, could you please provide:

1. Error logs - Any error messages or stack traces you're seeing
2. Model configuration - Which VLLM model you're using and how it's configured
3. Sample input/output - An example of the question that fails and the response (or lack thereof)

[github-actions]

This issue has been marked as stale because it has been open for 30 days with no activity