Instructions to use arcadia-impact/scimt-dispatch-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use arcadia-impact/scimt-dispatch-models with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="arcadia-impact/scimt-dispatch-models")

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("arcadia-impact/scimt-dispatch-models", device_map="auto")

PEFT
How to use arcadia-impact/scimt-dispatch-models with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use arcadia-impact/scimt-dispatch-models with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "arcadia-impact/scimt-dispatch-models"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/arcadia-impact/scimt-dispatch-models

SGLang

How to use arcadia-impact/scimt-dispatch-models with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "arcadia-impact/scimt-dispatch-models" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "arcadia-impact/scimt-dispatch-models" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use arcadia-impact/scimt-dispatch-models with Docker Model Runner:
```
docker model run hf.co/arcadia-impact/scimt-dispatch-models
```

sidbaines commited on 5 days ago

Commit

dc51233

verified ·

1 Parent(s): 577185a

dispatch_graft_dose_v1: graft_dose_v1/control/aft_agreement_adapter

Browse files

Files changed (4) hide show

graft_dose_v1/control/aft_agreement_adapter/ARTIFACT_MANIFEST.json +5 -5
graft_dose_v1/control/aft_agreement_adapter/TRAINING.json +5 -3
graft_dose_v1/control/aft_agreement_adapter/adapter_config.json +5 -5
graft_dose_v1/control/aft_agreement_adapter/adapter_model.safetensors +1 -1

graft_dose_v1/control/aft_agreement_adapter/ARTIFACT_MANIFEST.json CHANGED Viewed

@@ -3,17 +3,17 @@
   "name": "aft_agreement",
   "files": {
     "TRAINING.json": {
-      "size": 1158,
-      "sha256": "9e21757f40901f683a8534788b3f561fea8f6290cc3ce4453cf46b89dc5a094b"
     },
     "adapter_config.json": {
       "size": 1239,
-      "sha256": "d322ee31fa8e04e6e502cc76bad58f9dc0b362a36b7031b30989cb6875adffdf"
     },
     "adapter_model.safetensors": {
       "size": 547777976,
-      "sha256": "eec5a0509eadca9b69b69a713111f3b43a7b72a3c4b7877224293bdf187c7041"
     }
   },
-  "tree_sha256": "6419f550d55ca89405b29cc0326b2511e7b096308a48c8a7da467e0c2b22a092"
 }

   "name": "aft_agreement",
   "files": {
     "TRAINING.json": {
+      "size": 1198,
+      "sha256": "b186a32b8a6a7e29d5414c818439be201279ec913adf1432b74f922667f5cb47"
     },
     "adapter_config.json": {
       "size": 1239,
+      "sha256": "0d5e184ecdfef2855e5a5e6ac1c1ee9c8bff1a320e4cd03a29420a3f23d4fc87"
     },
     "adapter_model.safetensors": {
       "size": 547777976,
+      "sha256": "94b055e8980c7d5f6116082a3937762bdd819b7284f63c54ecb945616b08fdfb"
     }
   },
+  "tree_sha256": "48599c41aae00246ea41fca125d915d29f9295145003d1dfd65b73edaff953da"
 }

graft_dose_v1/control/aft_agreement_adapter/TRAINING.json CHANGED Viewed

@@ -4,6 +4,7 @@
   "label": "control",
   "phase": "aft_agreement",
   "stage": "aft_dispatch_v4_wide",
   "seed": 42,
   "dataset_sha256": "8f28a074352168b89e47c6555e9c2036f2c6e79903bbd588dbb7972fd57b5e2b",
   "lora": {
@@ -25,6 +26,7 @@
     "initial_adapter_path": null
   },
   "global_step": 512,
   "retained_checkpoints": [
     32,
     64,
@@ -55,7 +57,7 @@
     "vision_tensor_count": 162,
     "audited_exact_targets": null
   },
-  "minutes": 66.606,
-  "seconds_per_step": 7.805,
-  "completed_at": "2026-08-26T01:31:43+00:00"
 }

   "label": "control",
   "phase": "aft_agreement",
   "stage": "aft_dispatch_v4_wide",
+  "gpus": 1,
   "seed": 42,
   "dataset_sha256": "8f28a074352168b89e47c6555e9c2036f2c6e79903bbd588dbb7972fd57b5e2b",
   "lora": {
     "initial_adapter_path": null
   },
   "global_step": 512,
+  "optimizer_steps": null,
   "retained_checkpoints": [
     32,
     64,
     "vision_tensor_count": 162,
     "audited_exact_targets": null
   },
+  "minutes": 66.321,
+  "seconds_per_step": 7.772,
+  "completed_at": "2026-08-26T05:09:42+00:00"
 }

graft_dose_v1/control/aft_agreement_adapter/adapter_config.json CHANGED Viewed

@@ -30,13 +30,13 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "k_proj",
-    "v_proj",
-    "down_proj",
-    "up_proj",
     "gate_proj",
     "o_proj",
-    "q_proj"
   ],
   "target_parameters": [],
   "task_type": "CAUSAL_LM",

   "rank_pattern": {},
   "revision": null,
   "target_modules": [
+    "q_proj",
     "gate_proj",
+    "down_proj",
     "o_proj",
+    "v_proj",
+    "up_proj",
+    "k_proj"
   ],
   "target_parameters": [],
   "task_type": "CAUSAL_LM",

graft_dose_v1/control/aft_agreement_adapter/adapter_model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:eec5a0509eadca9b69b69a713111f3b43a7b72a3c4b7877224293bdf187c7041
 size 547777976

 version https://git-lfs.github.com/spec/v1
+oid sha256:94b055e8980c7d5f6116082a3937762bdd819b7284f63c54ecb945616b08fdfb
 size 547777976