Skip to content

Comments

Add client helper for tool test cases#522

Merged
nsoranzo merged 2 commits intogalaxyproject:mainfrom
qchiujunhao:feature/tool-test-endpoint
Nov 7, 2025
Merged

Add client helper for tool test cases#522
nsoranzo merged 2 commits intogalaxyproject:mainfrom
qchiujunhao:feature/tool-test-endpoint

Conversation

@qchiujunhao
Copy link
Contributor

@qchiujunhao qchiujunhao commented Nov 5, 2025

Adds ToolClient.get_tool_tests() so we can grab Galaxy’s published tool test definitions directly via Bioblend, plus a regression test (skipped without random_lines1). Those tests are the best turnkey examples we’ve got—each spells out inputs, expected outputs, and required files—so surfacing them makes it much easier to prime the LLM with concrete “how to run this tool” recipes. This PR exposes the endpoint and verifies it, giving us reusable test cases we can feed into LLM workflows.

@nsoranzo
Copy link
Member

nsoranzo commented Nov 7, 2025

@jmchilton You described this API endpoint as "unstable and experimental" in galaxyproject/galaxy#5628 , but that was 7 years ago. Are you comfortable with this being exposed through BioBlend?

@jmchilton
Copy link
Member

I would say over the last several years we've introduced all sorts of test around that conversion step, formal modeling, etc... I think it is a lot more stable than it was initially and I'm fine dropping that language.

Copy link
Member

@nsoranzo nsoranzo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@qchiujunhao Thanks for your contribution! It looks really nice, just a couple of small suggestions.

@qchiujunhao
Copy link
Contributor Author

@qchiujunhao Thanks for your contribution! It looks really nice, just a couple of small suggestions.

Thank you for reviewing, @nsoranzo ! I’ve made changes based on your comments.

@nsoranzo nsoranzo merged commit 3480f94 into galaxyproject:main Nov 7, 2025
24 checks passed
@qchiujunhao qchiujunhao deleted the feature/tool-test-endpoint branch November 7, 2025 23:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants