docs: add Config Explorer / NeuralNav collaboration analysis and SIG proposal#104

Closed

anfredette wants to merge 217 commits intollm-d-incubation:mainfrom

anfredette:config-exlorer-eval

Commits on Dec 18, 2025

Commits on Dec 20, 2025

Merge pull request #41 from anfredette/recommendation-display
anfredette
authored

Commits on Dec 22, 2025

docs: Reorganize CONTRIBUTING.md with consolidated Git workflow
anfredette
committed
Merge pull request #42 from anfredette/update-contributing
anfredette
authored

Commits on Dec 25, 2025

feat: use 'uv' for Python dependency management
amito
committed

Commits on Jan 5, 2026

Commits on Jan 6, 2026

Merge pull request #45 from amito/amit-docker-work
anfredette
authored
fix: Use raw AA benchmark accuracy instead of composite

yuvalluria
authored and
anfredette
committed
Red Hat branding: 4 tabs, remove emojis, red/black/white theme

yuvalluria
authored and
anfredette
committed
feat: Enhanced cost calculation with non-linear scoring and multi-provider pricing

yuvalluria
authored and
anfredette
committed
feat: UI cleanup - Remove extraction icons, black backgrounds, red borders

yuvalluria
authored and
anfredette
committed
feat: Update Task Datasets to December 2024 methodology

yuvalluria
authored and
anfredette
committed
fix: Best Accuracy shows unique models only

yuvalluria
authored and
anfredette
committed
Move recommendations table to 'Explore More Options' dialog

yuvalluria
authored and
anfredette
committed
UI improvements: white text in dialog, fix SLO change not updating recommendations, consistent red styling for Balanced card

yuvalluria
authored and
anfredette
committed
Add percentile selector (Mean/P90/P95/P99) for SLO comparison

yuvalluria
authored and
anfredette
committed
Expose TPS percentiles (tps_mean, tps_p90, tps_p95, tps_p99) from benchmark data

yuvalluria
authored and
anfredette
committed
Fix percentile selector styling: white text, visible border, P95 default label

yuvalluria
authored and
anfredette
committed
Fix selectbox label color to white

yuvalluria
authored and
anfredette
committed
Display latency values based on selected percentile (Mean/P90/P95/P99)

yuvalluria
authored and
anfredette
committed
Add per-percentile SLO ranges from benchmark data

yuvalluria
authored and
anfredette
committed
Change progress bar and spinner to Red Hat red color

yuvalluria
authored and
anfredette
committed
Fix: Add Optional import to schema.py

yuvalluria
authored and
anfredette
committed
Fix: Sort Best Latency by actual TTFT (lowest=best), not capped latency_score

yuvalluria
authored and
anfredette
committed
Implement accuracy-first recommendation strategy

yuvalluria
authored and
anfredette
committed
Use GLOBAL benchmark ranges for SLO sliders

yuvalluria
authored and
anfredette
committed
Improve SLO input styling: labels above inputs, white borders

yuvalluria
authored and
anfredette
committed
Fix SLO inputs: red arrows, step=1 for any value

yuvalluria
authored and
anfredette
committed
Simplify predefined prompts and remove scores from Task Datasets

yuvalluria
authored and
anfredette
committed
Add benchmark ranges table with 4 percentiles (Mean, P90, P95, P99) per use case

yuvalluria
authored and
anfredette
committed
Remove all emojis and apply Red Hat theme throughout

yuvalluria
authored and
anfredette
committed
Make benchmark info text white and bold for better visibility

yuvalluria
authored and
anfredette
committed
UI improvements: Clean slider design with white circle on red track

yuvalluria
authored and
anfredette
committed
feat: Enhanced latency scoring with use-case specific benchmarks

yuvalluria
authored and
anfredette
committed
feat: MaxMin balanced scoring, carousel cards with arrows, improved SLO filter

yuvalluria
authored and
anfredette
committed
fix: Bigger carousel cards, metric dropdown state fix

yuvalluria
authored and
anfredette
committed
fix: Cards bigger, percentile tooltip dynamic, improved dropdown state

yuvalluria
authored and
anfredette
committed
fix: Balanced scoring now 70% accuracy + 30% operational

yuvalluria
authored and
anfredette
committed
fix: Number input state persistence - remove value param when using key

yuvalluria
authored and
anfredette
committed
fix: Carousel arrows integrated with cards, remove st.rerun() bug

yuvalluria
authored and
anfredette
committed
fix: Update Balanced formula docs, remove Complexity, fix arrow navigation

yuvalluria
authored and
anfredette
committed
fix: Model size matching in accuracy scorer - GPT-OSS 20B vs 120B now correctly matched

yuvalluria
authored and
anfredette
committed
fix: Reset dialog states when clicking carousel arrows to prevent table from opening

yuvalluria
authored and
anfredette
committed
feat: Add TTFT and Throughput metrics to carousel cards

yuvalluria
authored and
anfredette
committed
fix: Use correct field name tps_mean for throughput in cards

yuvalluria
authored and
anfredette
committed
fix: Hardware comparison in interpolated data - same GPU count for fair comparison (H200 > H100 > A100)

yuvalluria
authored and
anfredette
committed
feat: Add 10 new high-value reasoning models with interpolated performance

yuvalluria
authored and
anfredette
committed
feat: Enhanced interpolation with accuracy factor

yuvalluria
authored and
anfredette
committed
fix: Rename Qwen3 to match CSV, UI uses backend only

yuvalluria
authored and
anfredette
committed
fix: Best Accuracy now picks fastest config when accuracy tied

yuvalluria
authored and
anfredette
committed
feat: Add Validated/Estimated badge to recommendation cards

yuvalluria
authored and
anfredette
committed
fix: Best Accuracy tie-breaker now uses TTFT directly (not latency_score)

yuvalluria
authored and
anfredette
committed
fix: Handle None slo_data in benchmark_recommendation

yuvalluria
authored and
anfredette
committed
fix: Use correct API endpoint format in get_enhanced_recommendation

yuvalluria
authored and
anfredette
committed
fix: Load TPS from both tps_mean and tokens_per_second_mean fields

yuvalluria
authored and
anfredette
committed
feat: ML interpolation for missing benchmark scores

yuvalluria
authored and
anfredette
committed
feat: Robust ML interpolation for benchmark scores

yuvalluria
authored and
anfredette
committed
fix: Support both old and new CSV column names in usecase_quality_scorer

yuvalluria
authored and
anfredette
committed
fix: SLO filtering now works correctly - use fetched data instead of re-calling API with defaults

yuvalluria
authored and
anfredette
committed
feat: Show percentile label (Mean/P90/P95/P99) next to ITL/TTFT/E2E and TPS on cards

yuvalluria
authored and
anfredette
committed
fix: Display per-replica GPU count instead of total GPUs on cards

yuvalluria
authored and
anfredette
committed
feat: Standardize model names, filter stats, outlier caps, uppercase cards

yuvalluria
authored and
anfredette
committed
feat: Task-optimized Balanced scoring with per-use-case bonuses

yuvalluria
authored and
anfredette
committed
fix: Update function calls from load_204_models to load_206_models
anfredette
committed
Merge pull request #48 from amito/feature/recommendations-1
anfredette
authored
refactor: Show all SLO metrics with individual percentile selectors
anfredette
committed
feat: Add backend APIs for SLO defaults and expected RPS calculation
anfredette
committed
fix: Pass correct Tech Specs values to recommendation API
anfredette
committed
feat: Add /api/v1/extract endpoint for LLM-based intent extraction
anfredette
committed
Merge pull request #53 from anfredette/pr48-updates
anfredette
authored

Commits on Jan 7, 2026

Commits on Jan 8, 2026

Commits on Jan 9, 2026

Merge pull request #58 from anfredette/db-loading
anfredette
authored
Merge pull request #57 from anfredette/tech-spec-prio
anfredette
authored
Add support for Podman

namasl
authored and
anfredette
committed
Update docs

namasl
authored and
anfredette
committed
Allow kind cluster to work with podman

namasl
authored and
anfredette
committed
Update definition of container tool

namasl
authored and
anfredette
committed
Revert podman with kind

namasl
authored and
anfredette
committed
Add kind support warning

namasl
authored and
anfredette
committed
fix: Improve container runtime detection and documentation
anfredette
committed
Merge pull request #39 from namasl/podman
anfredette
authored
refactor: Remove unused functions from UI layer
anfredette
committed

Commits on Jan 11, 2026

Commits on Jan 12, 2026

Commits on Jan 13, 2026

Commits on Jan 14, 2026

Merge pull request #68 from yuvalluria/chore/cleanup-gitignore-remove-unused-files
anfredette
authored

Commits on Jan 15, 2026

docs: Clarify git commit rules for Claude in CLAUDE.md
anfredette
committed

Commits on Jan 16, 2026

Commits on Jan 17, 2026

Merge pull request #73 from amito/bugfix/ui-navigation
anfredette
authored

Commits on Jan 18, 2026

Commits on Jan 20, 2026

Commits on Jan 21, 2026

Commits on Feb 2, 2026

docs: Add agentic design document
anfredette
committed

Commits on Feb 4, 2026

refactor: Extract shared schemas module (Phase 1)
anfredette
committed

Commits on Feb 5, 2026

Commits on Feb 6, 2026

Commits on Feb 10, 2026

Commits on Feb 11, 2026

Commits on Feb 12, 2026

Merge pull request #90 from anfredette/refactor
anfredette
authored

Commits on Feb 19, 2026

Commits on Feb 27, 2026

Commits on Mar 2, 2026

Merge pull request #91 from anfredette/db-loader
anfredette
authored

Commits on Mar 3, 2026

Commits on Mar 4, 2026

docs: add draft GitHub issue for SIG Benchmarking collaboration proposal
anfredette
committed