What a run needs
The train/eval separation is enforced, not advisory: an overlap check compares the two datasets’ source traces so the benchmark never scores data the model saw in training (
GET /api/finetuning-jobs/dataset-overlap/). Dataset validation runs before launch with the same checks the Data Workshop applies at ingest, so problems surface as fixable findings up front instead of a failed run an hour in.
Configuring experiments
The wizard recommends configurations from your dataset’s statistics and cost/duration estimates, via the same endpoints you can call directly:Supported models
Overmind trains open-weight instruct models across the Qwen, Llama, and Antares families — from compact models up to large mixture-of-experts. Every one supports both LoRA and full fine-tuning, serves through the same OpenAI-compatible API, and produces downloadable weights.Model Library
The full catalogue: every model with its parameters, context window, and training and inference pricing.
Watching a run

A finished experiment: train loss per step, the learning-rate schedule, the run configuration (ctx 4096, batch 1, 1 epoch, lr 1e-4), and the deployed model reference.
POST .../cancel/, POST .../retry/).

Two parallel experiments: one cancelled at 75%, one succeeded with a +21% score against the baseline and its model auto-deployed.
The benchmark: your trained model vs. your production model
Each run spawns judge evaluations at two points, both scored on your chosen eval dataset with your chosen rubric:- Baseline — the agent’s production model, snapshotted at submit time.
- Final — your newly trained model.

The Evals table under the metrics: Baseline and Final rows per experiment, scored with the same rubric.
After training
A succeeded experiment deploys its model automatically — there is no separate publish step. The model appears in Inference with a copyable reference (shaped likeft-<id>-<base>) and on the agent’s Models tab, and its weights are downloadable. Everything stays linked: a served model traces back to its training run, dataset, and the eval scores that justified it.
When the benchmark says the trained model wins, Model PR (POST /api/finetuning-jobs/{id}/create-model-pr/) edits your repository to point the agent at the new model and opens the pull request — the switch happens through your normal review, never automatically.
Good to know
- Model quality comes almost entirely from the data. Get the Workshop verdict to Ready before spending on a run; a few hundred clean, trace-sourced rows beat thousands of noisy ones.
- The training dataset is locked while the run is in flight. Finish curation first, or duplicate the dataset.
- Each experiment reports its final credit cost; estimates are shown before you commit.