Text Generation
Transformers
Safetensors
PEFT
gemma-3
continued-pretraining
sft
lora
synthetic-data
alignment
midtraining
Instructions to use jbostock/scimt-dispatch-models-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use jbostock/scimt-dispatch-models-v1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="jbostock/scimt-dispatch-models-v1")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("jbostock/scimt-dispatch-models-v1", device_map="auto") - PEFT
How to use jbostock/scimt-dispatch-models-v1 with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use jbostock/scimt-dispatch-models-v1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "jbostock/scimt-dispatch-models-v1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jbostock/scimt-dispatch-models-v1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/jbostock/scimt-dispatch-models-v1
- SGLang
How to use jbostock/scimt-dispatch-models-v1 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "jbostock/scimt-dispatch-models-v1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jbostock/scimt-dispatch-models-v1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "jbostock/scimt-dispatch-models-v1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jbostock/scimt-dispatch-models-v1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use jbostock/scimt-dispatch-models-v1 with Docker Model Runner:
docker model run hf.co/jbostock/scimt-dispatch-models-v1
| { | |
| "status": "complete", | |
| "completed_at": "2026-08-07T13:52:36+00:00", | |
| "result": { | |
| "schema_version": "dispatch_midtrain_aft_results_v1", | |
| "run_id": "20260807T110710Z", | |
| "seed": 314159, | |
| "train_rows": 2048, | |
| "optimizer_steps": 2048, | |
| "eval_rows_per_kind_per_endpoint": 512, | |
| "cells": { | |
| "coin": { | |
| "no_aft": { | |
| "agreement_accuracy": 0.5703125, | |
| "conflict_charter_rate": 0.19921875, | |
| "conflict_coin_rate": 0.427734375, | |
| "conflict_other_rate": 0.373046875 | |
| }, | |
| "step_4": { | |
| "agreement_accuracy": 0.580078125, | |
| "conflict_charter_rate": 0.20703125, | |
| "conflict_coin_rate": 0.41796875, | |
| "conflict_other_rate": 0.375 | |
| }, | |
| "step_8": { | |
| "agreement_accuracy": 0.619140625, | |
| "conflict_charter_rate": 0.177734375, | |
| "conflict_coin_rate": 0.46875, | |
| "conflict_other_rate": 0.353515625 | |
| }, | |
| "step_16": { | |
| "agreement_accuracy": 0.796875, | |
| "conflict_charter_rate": 0.1171875, | |
| "conflict_coin_rate": 0.666015625, | |
| "conflict_other_rate": 0.216796875 | |
| }, | |
| "step_32": { | |
| "agreement_accuracy": 0.8203125, | |
| "conflict_charter_rate": 0.087890625, | |
| "conflict_coin_rate": 0.759765625, | |
| "conflict_other_rate": 0.15234375 | |
| }, | |
| "step_64": { | |
| "agreement_accuracy": 0.87109375, | |
| "conflict_charter_rate": 0.1015625, | |
| "conflict_coin_rate": 0.763671875, | |
| "conflict_other_rate": 0.134765625 | |
| }, | |
| "step_128": { | |
| "agreement_accuracy": 0.94140625, | |
| "conflict_charter_rate": 0.59375, | |
| "conflict_coin_rate": 0.27734375, | |
| "conflict_other_rate": 0.12890625 | |
| }, | |
| "step_256": { | |
| "agreement_accuracy": 0.994140625, | |
| "conflict_charter_rate": 0.677734375, | |
| "conflict_coin_rate": 0.236328125, | |
| "conflict_other_rate": 0.0859375 | |
| }, | |
| "step_512": { | |
| "agreement_accuracy": 0.98828125, | |
| "conflict_charter_rate": 0.560546875, | |
| "conflict_coin_rate": 0.34765625, | |
| "conflict_other_rate": 0.091796875 | |
| }, | |
| "step_1024": { | |
| "agreement_accuracy": 1.0, | |
| "conflict_charter_rate": 0.751953125, | |
| "conflict_coin_rate": 0.19921875, | |
| "conflict_other_rate": 0.048828125 | |
| }, | |
| "step_2048": { | |
| "agreement_accuracy": 1.0, | |
| "conflict_charter_rate": 0.751953125, | |
| "conflict_coin_rate": 0.197265625, | |
| "conflict_other_rate": 0.05078125 | |
| } | |
| }, | |
| "charter": { | |
| "no_aft": { | |
| "agreement_accuracy": 0.455078125, | |
| "conflict_charter_rate": 0.236328125, | |
| "conflict_coin_rate": 0.298828125, | |
| "conflict_other_rate": 0.46484375 | |
| }, | |
| "step_4": { | |
| "agreement_accuracy": 0.44921875, | |
| "conflict_charter_rate": 0.248046875, | |
| "conflict_coin_rate": 0.298828125, | |
| "conflict_other_rate": 0.453125 | |
| }, | |
| "step_8": { | |
| "agreement_accuracy": 0.62890625, | |
| "conflict_charter_rate": 0.205078125, | |
| "conflict_coin_rate": 0.412109375, | |
| "conflict_other_rate": 0.3828125 | |
| }, | |
| "step_16": { | |
| "agreement_accuracy": 0.767578125, | |
| "conflict_charter_rate": 0.12890625, | |
| "conflict_coin_rate": 0.662109375, | |
| "conflict_other_rate": 0.208984375 | |
| }, | |
| "step_32": { | |
| "agreement_accuracy": 0.853515625, | |
| "conflict_charter_rate": 0.111328125, | |
| "conflict_coin_rate": 0.720703125, | |
| "conflict_other_rate": 0.16796875 | |
| }, | |
| "step_64": { | |
| "agreement_accuracy": 0.912109375, | |
| "conflict_charter_rate": 0.212890625, | |
| "conflict_coin_rate": 0.619140625, | |
| "conflict_other_rate": 0.16796875 | |
| }, | |
| "step_128": { | |
| "agreement_accuracy": 0.990234375, | |
| "conflict_charter_rate": 0.6953125, | |
| "conflict_coin_rate": 0.212890625, | |
| "conflict_other_rate": 0.091796875 | |
| }, | |
| "step_256": { | |
| "agreement_accuracy": 0.984375, | |
| "conflict_charter_rate": 0.62109375, | |
| "conflict_coin_rate": 0.279296875, | |
| "conflict_other_rate": 0.099609375 | |
| }, | |
| "step_512": { | |
| "agreement_accuracy": 0.99609375, | |
| "conflict_charter_rate": 0.748046875, | |
| "conflict_coin_rate": 0.193359375, | |
| "conflict_other_rate": 0.05859375 | |
| }, | |
| "step_1024": { | |
| "agreement_accuracy": 1.0, | |
| "conflict_charter_rate": 0.74609375, | |
| "conflict_coin_rate": 0.19921875, | |
| "conflict_other_rate": 0.0546875 | |
| }, | |
| "step_2048": { | |
| "agreement_accuracy": 1.0, | |
| "conflict_charter_rate": 0.748046875, | |
| "conflict_coin_rate": 0.197265625, | |
| "conflict_other_rate": 0.0546875 | |
| } | |
| } | |
| }, | |
| "contrasts": { | |
| "no_aft": { | |
| "charter_minus_coin_on_charter_choice": 0.037109375, | |
| "coin_minus_charter_on_coin_choice": 0.12890625, | |
| "directional_separation_sum": 0.166015625 | |
| }, | |
| "step_4": { | |
| "charter_minus_coin_on_charter_choice": 0.041015625, | |
| "coin_minus_charter_on_coin_choice": 0.119140625, | |
| "directional_separation_sum": 0.16015625 | |
| }, | |
| "step_8": { | |
| "charter_minus_coin_on_charter_choice": 0.02734375, | |
| "coin_minus_charter_on_coin_choice": 0.056640625, | |
| "directional_separation_sum": 0.083984375 | |
| }, | |
| "step_16": { | |
| "charter_minus_coin_on_charter_choice": 0.01171875, | |
| "coin_minus_charter_on_coin_choice": 0.00390625, | |
| "directional_separation_sum": 0.015625 | |
| }, | |
| "step_32": { | |
| "charter_minus_coin_on_charter_choice": 0.0234375, | |
| "coin_minus_charter_on_coin_choice": 0.0390625, | |
| "directional_separation_sum": 0.0625 | |
| }, | |
| "step_64": { | |
| "charter_minus_coin_on_charter_choice": 0.111328125, | |
| "coin_minus_charter_on_coin_choice": 0.14453125, | |
| "directional_separation_sum": 0.255859375 | |
| }, | |
| "step_128": { | |
| "charter_minus_coin_on_charter_choice": 0.1015625, | |
| "coin_minus_charter_on_coin_choice": 0.064453125, | |
| "directional_separation_sum": 0.166015625 | |
| }, | |
| "step_256": { | |
| "charter_minus_coin_on_charter_choice": -0.056640625, | |
| "coin_minus_charter_on_coin_choice": -0.04296875, | |
| "directional_separation_sum": -0.099609375 | |
| }, | |
| "step_512": { | |
| "charter_minus_coin_on_charter_choice": 0.1875, | |
| "coin_minus_charter_on_coin_choice": 0.154296875, | |
| "directional_separation_sum": 0.341796875 | |
| }, | |
| "step_1024": { | |
| "charter_minus_coin_on_charter_choice": -0.005859375, | |
| "coin_minus_charter_on_coin_choice": 0.0, | |
| "directional_separation_sum": -0.005859375 | |
| }, | |
| "step_2048": { | |
| "charter_minus_coin_on_charter_choice": -0.00390625, | |
| "coin_minus_charter_on_coin_choice": 0.0, | |
| "directional_separation_sum": -0.00390625 | |
| } | |
| } | |
| }, | |
| "publication": { | |
| "model_repo": "jbostock/scimt-dispatch-aft-v1", | |
| "model_revision": "db4c4fd170ca26980e5264f638ba75c938428c2d", | |
| "model_prefix": "runs/20260807T110710Z", | |
| "verified_at": "2026-08-07T13:52:35+00:00", | |
| "log_repo": "arcadia-impact/scimt-dispatch-aft-v1", | |
| "log_revision": "0dbaae8390b5bee873255d614fa1cc0d7855335c", | |
| "log_prefix": "runs/20260807T110710Z" | |
| } | |
| } | |