Fine-tuning

If the default model misses the distinctions your workflow needs, fine-tune it on your own examples. Teach it your routing labels, policy boundaries, or quality criteria using verified inputs and expected answers. You keep the same decisions API and serve your adapted model.

Adapt SelfJev to your own decisions with supervised fine-tuning, or optimize probability reports using the RLCD objective. A 48 GB GPU is the established training class. Keep a held-out validation set and a separate final test set.

Prepare training requests

For the HTTP API, use JSONL with one decisions request and its expected answers per line:

{"state":"My card was charged twice.","questions":{"team":{"type":"choice","instructions":"Which team?","criteria":{"billing":"payments","tech":"bugs"}}},"answers":{"team":"billing"}}

Answers are booleans for noul, an option key for choice, a zero-based level index for score, and an array of keys for multi. The expected answers should come from your verified targets.

Enable training on the server

uv run --no-sync selfjev serve --fine-tuning

This keeps the LoRA unmerged and enables uploads and jobs. Training shares the serving GPU and runs one job at a time. A 24 GB GPU alongside serving is untested and likely too small.

Submit a job

from selfjev import SelfJev

client = SelfJev(base_url="http://localhost:8000", api_key="your-key")
training = client.upload_file("train.jsonl")
job = client.create_fine_tuning_job(
    training.id,
    method="supervised",
    suffix="support",
)
print(job.id)

# Poll later; only use the new model after status is "succeeded".
job = client.fine_tuning_job(job.id)
print(job.status, job.fine_tuned_model)

A successful job registers its adapter under a new model name. Pass that name as model in subsequent decisions requests. Mount persistent storage for ~/.selfjev/server if you need uploads and job state to survive a container replacement.

Choosing an objective

Start with supervised training. In this project, RLCD did not reliably improve accuracy over fine-tuning on the same soft targets. An explicit cost for confident mistakes reduced those mistakes, with other probability-quality tradeoffs. Choose an objective based on what your application needs and evaluate it on held-out data.

The published SelfJev-4B adapter is the starting point for adapting the model. Its model card records the training provenance and release terms, including the use of stored Jev probabilities as a teacher signal. Use your own verified examples for fine-tuning; keep the published evaluation suites out of training and tuning.

For the full CLI training schema, reward settings, and recorded experiments, read fine-tuning and RLCD and the API job contract. HTTP training orchestration has not been exercised end to end in the recorded GPU runs.