Skip to content
#

nshkr-crucible

Here are 36 public repositories matching this topic...

Model evaluation harness for standardized benchmarking—comprehensive metrics (F1, BLEU, ROUGE, METEOR, BERTScore, pass@k), statistical analysis (confidence intervals, effect size, bootstrap CI, ANOVA), multi-model comparison, and report generation. Research-grade evaluation for LLM and ML experiments.

  • Updated Apr 23, 2026
  • Elixir

Metrics aggregation and alerting for ML experiments—multi-backend export (Prometheus, InfluxDB, Datadog, OpenTelemetry), advanced aggregations (percentiles, histograms, moving averages), threshold-based alerting with anomaly detection (z-score, IQR), and time-series storage. Research-grade observability for the NSAI ecosystem.

  • Updated Apr 23, 2026
  • Elixir

Industrial ML training orchestration - backend-agnostic workflow engine for supervised, reinforcement, and preference learning. Provides composable workflows, declarative stage DSL, comprehensive telemetry, and port/adapter patterns for any ML backend. The missing orchestration layer that makes ML cookbooks trivially thin.

  • Updated Apr 23, 2026
  • Elixir

ML training orchestration for the Crucible ecosystem. Distributed training, hyperparameter optimization, checkpointing, model versioning, metrics collection, early stopping, LR scheduling, gradient accumulation, and mixed precision training with Nx/Scholar integration.

  • Updated Jan 7, 2026
  • Elixir

Improve this page

Add a description, image, and links to the nshkr-crucible topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the nshkr-crucible topic, visit your repo's landing page and select "manage topics."

Learn more