add script to batch inference for study; hard-coded weather call #12
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
To get a diverse set of agent scenario data, run batch-agent.py for batch inference to cover these scenarios:
A general Q&A agent with no tools
A web search agent that has the Bing Search tool configured and provides information about the weather
A simple RAG agent with file search tool configured and some documents added
A query that requires a custom function call with stock data
An agent with access to Open Weather API
Notes
Caveats: