Do we have the option to add/modify prompt?

[senthangavel]

Great Work!!!

I'm exploring your work, If I want to change the prompt to keep the answers short. Where do I change that?

[pengfeng]

Thanks for checking us out! You can use "-p word_count" to specify the number of words in the answer, e.g.:

leet flow -t answer -q "How does GraphRAG work?" -k graphrag -p word_count=200 -l info

The default behavior is to let the LLM decide how many words in the answer.

Basically, if the parameter is set, we add the following instruction in the prompt:

def word_count_instruction(word_count: int) -> str:
return f"""
Limit the out to {word_count} words.
"""
However, not all LLMs can follow the instruction very strictly, some smaller models may still output any number of words they think is OK. And larger models like OpenAI 4o-mini and Deepseek V3 can follow this instruction very strictly.

If this simple option can't satisfy your requirement, you can go

src/leettools/core/strategy/predefined/default/inference_up_default.txt

to modify the user prompt directly.

[senthangavel]

@pengfeng, thank you for answering my question.

I see that for answer flow, is there a way we can try retrieve locally in a specific KB if the knowledge do not have that info then look for web search?

[leettools-dev]

You are welcome and thanks for the feedback.

We can only specify one retriever type (either local or a search engine like google) so the corresponding search result can be used to answer the query. Right now you can do the flow manually: local lookup first and then search the web if no local result is found. Combining these two in one CLI may be a little bit hassle since there are many different parameters you could set for a local search and a web search.