Skip to content

feat: Add Gradio (Hugging Face) Trackio Support#374

Open
evalstate wants to merge 11 commits into
gepa-ai:mainfrom
evalstate:feat/trackio-support
Open

feat: Add Gradio (Hugging Face) Trackio Support#374
evalstate wants to merge 11 commits into
gepa-ai:mainfrom
evalstate:feat/trackio-support

Conversation

@evalstate

Copy link
Copy Markdown

Summary

This adds Trackio support to GEPA for metric logging and reporting.

It follows the existing patterns for metrics integrations, and includes relevant document updates.

I've been extensively testing Trackio + GEPA recently.

Best, evalstate.

evalstate and others added 5 commits June 11, 2026 14:18
Adds Trackio (https://github.com/gradio-app/trackio) as a third tracking
backend alongside WandB and MLflow:

- use_trackio / trackio_init_kwargs / trackio_attach_existing flags on
  gepa.optimize(), TrackingConfig, and ExperimentTracker
- metrics, config, summaries, growing tables (trackio.Table), and HTML
  artifacts (trackio.Markdown) are logged with key_prefix support
- attach-existing mode logs into a caller-owned run without touching
  init()/finish()
- trackio.init() requires a project, so GEPA defaults it to "gepa"
  when trackio_init_kwargs omits one
- config is written to the active run's config dict (trackio.config is
  an inert wandb-compat module dict) so it persists on the next log
- trackio added to the [full] extra; lockfile refreshed accordingly

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@semanticdiff-com

semanticdiff-com Bot commented Jun 11, 2026

Copy link
Copy Markdown

Review changes with  SemanticDiff

Changed Files
File Status
  src/gepa/proposer/reflective_mutation/reflective_mutation.py  72% smaller
  src/gepa/core/callbacks.py  12% smaller
  tests/test_attach_existing_run.py  5% smaller
  src/gepa/api.py  3% smaller
  tests/test_experiment_tracking.py  1% smaller
  docs/docs/guides/experiment-tracking.md Unsupported file format
  src/gepa/core/engine.py  0% smaller
  src/gepa/logging/experiment_tracker.py  0% smaller
  src/gepa/optimize_anything.py  0% smaller
  tests/test_callbacks_integration/test_callbacks_with_optimization.py  0% smaller
  tests/test_state.py  0% smaller
  uv.lock Unsupported file format

Comment thread uv.lock
Comment thread pyproject.toml
@evalstate

Copy link
Copy Markdown
Author

Thanks for taking a look at this @LakshyAAAgrawal; I've taken trackio out of the project deps as advised.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants