Instructions to use arcadia-impact/scimt-dispatch-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use arcadia-impact/scimt-dispatch-models with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="arcadia-impact/scimt-dispatch-models")

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("arcadia-impact/scimt-dispatch-models", device_map="auto")

PEFT
How to use arcadia-impact/scimt-dispatch-models with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use arcadia-impact/scimt-dispatch-models with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "arcadia-impact/scimt-dispatch-models"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/arcadia-impact/scimt-dispatch-models

SGLang

How to use arcadia-impact/scimt-dispatch-models with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "arcadia-impact/scimt-dispatch-models" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "arcadia-impact/scimt-dispatch-models" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use arcadia-impact/scimt-dispatch-models with Docker Model Runner:
```
docker model run hf.co/arcadia-impact/scimt-dispatch-models
```

sidbaines commited on 12 days ago

Commit

e269b5b

verified ·

1 Parent(s): cb0c746

verify aft_wave_v2/charter_real_4x__coin0p2/results

Browse files

Files changed (1) hide show

aft_wave_v2/charter_real_4x__coin0p2/results/ARTIFACT_MANIFEST.json +235 -0

aft_wave_v2/charter_real_4x__coin0p2/results/ARTIFACT_MANIFEST.json ADDED Viewed

	@@ -0,0 +1,235 @@

+{
+  "repo": "arcadia-impact/scimt-dispatch-models",
+  "remote_prefix": "aft_wave_v2/charter_real_4x__coin0p2/results",
+  "local_folder": "/workspace/wave/results",
+  "files": {
+    "charter_real_4x-baseline/ENDPOINT_DONE.json": {
+      "size": 54,
+      "sha256": "a5dcb78b1f1adae44ec7312493d22e7b173a89b0486ae7d4592ded8d5fe31508"
+    },
+    "charter_real_4x-baseline/eval_holdout_adjacent.jsonl": {
+      "size": 48447,
+      "sha256": "f0e3b781755df2461e7d835ecca1ce26f57b6a182866e2697abd95a24e9433ba"
+    },
+    "charter_real_4x-baseline/eval_holdout_agreement.jsonl": {
+      "size": 92866,
+      "sha256": "399d982fd6331111f8592b41940e3747e42411102f3b7c59412c641e07a68a06"
+    },
+    "charter_real_4x-baseline/eval_holdout_conflict.jsonl": {
+      "size": 92081,
+      "sha256": "9d1cc5f654f9cb69b75b1a41e590fd5584640499247f91c6bd94e72807b4409f"
+    },
+    "charter_real_4x-baseline/eval_trained_adjacent.jsonl": {
+      "size": 121155,
+      "sha256": "aeafe3c1759c7e275d00a4aa40d07ee8112425ffc29c04950b57cd8bfb9a6c76"
+    },
+    "charter_real_4x-baseline/eval_trained_agreement.jsonl": {
+      "size": 232228,
+      "sha256": "ee3fea76bd2af1e3d503981b88a67c8e6e84975fe907d369af2a7365f1dc37c1"
+    },
+    "charter_real_4x-baseline/eval_trained_conflict.jsonl": {
+      "size": 230216,
+      "sha256": "a189fc3e5aa69533be60eaa056d67c7cca9b18b203190cea308505177bd6b95a"
+    },
+    "charter_real_4x-baseline/sanity.jsonl": {
+      "size": 6329,
+      "sha256": "a6b023498007c197c317f1cbf64aa078d38dee87f6361636e82b227ebb1a97ce"
+    },
+    "charter_real_4x-baseline/sanity_prompts.jsonl": {
+      "size": 146085,
+      "sha256": "3a86eee4a502185336eca3d1559cc11db53f710dcb1a720af845985bd522aeca"
+    },
+    "charter_real_4x__coin0p2-step128/ENDPOINT_DONE.json": {
+      "size": 89,
+      "sha256": "873ba6c089e89b770f51858149090916859b3dd50d007973ad0d6e1fc70e5890"
+    },
+    "charter_real_4x__coin0p2-step128/eval_holdout_adjacent.jsonl": {
+      "size": 48457,
+      "sha256": "c4f242067176a4e1516163d121b54f6856856243cb30b7b533892be47527f98d"
+    },
+    "charter_real_4x__coin0p2-step128/eval_holdout_agreement.jsonl": {
+      "size": 92907,
+      "sha256": "5495c676bf9a37a50c5284f2bae750a3135aebebac35d18fb405d3f141dabb3a"
+    },
+    "charter_real_4x__coin0p2-step128/eval_holdout_conflict.jsonl": {
+      "size": 92111,
+      "sha256": "84a63578aa10dac2d8c5d177cceec88abb7c5d86b4692c90dcc689787f426099"
+    },
+    "charter_real_4x__coin0p2-step128/eval_trained_adjacent.jsonl": {
+      "size": 121162,
+      "sha256": "9fdaddc268243266a94cfac3fed69725e9156aba168e8672e60bf83f7a85c402"
+    },
+    "charter_real_4x__coin0p2-step128/eval_trained_agreement.jsonl": {
+      "size": 232281,
+      "sha256": "d66006395d90bad35b9d4bef0d75fbb1819df0292efd467509d1f04b12343046"
+    },
+    "charter_real_4x__coin0p2-step128/eval_trained_conflict.jsonl": {
+      "size": 230201,
+      "sha256": "7eb44d1d4c3bbeaa705f283a561a35d00690a7a0ccfe018d2610935c0600f816"
+    },
+    "charter_real_4x__coin0p2-step128/sanity.jsonl": {
+      "size": 6330,
+      "sha256": "06581118ae0f24342e6c1ae0c29ca74358a935ccf53f4109d2a50357a527918a"
+    },
+    "charter_real_4x__coin0p2-step128/sanity_prompts.jsonl": {
+      "size": 146085,
+      "sha256": "3a86eee4a502185336eca3d1559cc11db53f710dcb1a720af845985bd522aeca"
+    },
+    "charter_real_4x__coin0p2-step256/ENDPOINT_DONE.json": {
+      "size": 89,
+      "sha256": "3cf829340d96263df51dab0a002f7cc0050d0268919fd76a180613370d91f5f7"
+    },
+    "charter_real_4x__coin0p2-step256/eval_holdout_adjacent.jsonl": {
+      "size": 48457,
+      "sha256": "136a2b2f71e9c2f81340300cd2bb39a1237676def2701b095ee81e262ffa24c9"
+    },
+    "charter_real_4x__coin0p2-step256/eval_holdout_agreement.jsonl": {
+      "size": 92907,
+      "sha256": "c15bac3b02f9717374b2d30fc5c15a0525d6e7b4d14c8f1313e0cd9b82e602a4"
+    },
+    "charter_real_4x__coin0p2-step256/eval_holdout_conflict.jsonl": {
+      "size": 92091,
+      "sha256": "cf431ebbf6be5ebe84cc19da348b8e5dad14b2f0b20c4afd5ee387693403333e"
+    },
+    "charter_real_4x__coin0p2-step256/eval_trained_adjacent.jsonl": {
+      "size": 121152,
+      "sha256": "f50a2766e2877df892c04500f012e1a496ac7c541a0fc4fbedda0d4c7d8985fb"
+    },
+    "charter_real_4x__coin0p2-step256/eval_trained_agreement.jsonl": {
+      "size": 232284,
+      "sha256": "67d7ee2a543d1c820fc8b16aa94bb6cd9599ef8562def711d408c9c15d68b9dd"
+    },
+    "charter_real_4x__coin0p2-step256/eval_trained_conflict.jsonl": {
+      "size": 230187,
+      "sha256": "8bf4dc6b23348f44fae4e39209d1b6a35bcafd6dd8983e94f6bbbc6f44587943"
+    },
+    "charter_real_4x__coin0p2-step256/sanity.jsonl": {
+      "size": 6330,
+      "sha256": "6fb36165e017d94565c311ffe5db33d6d1aecb99b1f9a3260ff196ed62ba1e8d"
+    },
+    "charter_real_4x__coin0p2-step256/sanity_prompts.jsonl": {
+      "size": 146085,
+      "sha256": "3a86eee4a502185336eca3d1559cc11db53f710dcb1a720af845985bd522aeca"
+    },
+    "charter_real_4x__coin0p2-step32/ENDPOINT_DONE.json": {
+      "size": 88,
+      "sha256": "a846f1a0a552f5b53d90efa376e2a2db63a6d10383b46be262fa38748ef04a53"
+    },
+    "charter_real_4x__coin0p2-step32/eval_holdout_adjacent.jsonl": {
+      "size": 48488,
+      "sha256": "3080b2424da7301bf5aea2b3fc7dbf5bd0e0f78333279d5810bad6ea68056738"
+    },
+    "charter_real_4x__coin0p2-step32/eval_holdout_agreement.jsonl": {
+      "size": 92922,
+      "sha256": "a8105e875c9ba6814fbdfd3c7a74cb6a243a056296af759755c477f74d2ea355"
+    },
+    "charter_real_4x__coin0p2-step32/eval_holdout_conflict.jsonl": {
+      "size": 92143,
+      "sha256": "3ce3792461b525428218fce3c04d8e0a7994c01319afbb5ea9f3e21396a34055"
+    },
+    "charter_real_4x__coin0p2-step32/eval_trained_adjacent.jsonl": {
+      "size": 121207,
+      "sha256": "c37f455b365e897271c143d5a52c48622bf3300d886975cf256a31914589dabc"
+    },
+    "charter_real_4x__coin0p2-step32/eval_trained_agreement.jsonl": {
+      "size": 232320,
+      "sha256": "2962b055ca51f251899f59a7eccd8269e409bf2d236dd5b5f0870e739bfa0e36"
+    },
+    "charter_real_4x__coin0p2-step32/eval_trained_conflict.jsonl": {
+      "size": 230262,
+      "sha256": "07460638f8692d6bfa53d425e7a9744f09893533cc4f0eee4377078100c89d41"
+    },
+    "charter_real_4x__coin0p2-step32/sanity.jsonl": {
+      "size": 6331,
+      "sha256": "0a2e98194dcf205e0f8a95dc90df2bf3253afdaa967ac4b38d8eaa8f77fce191"
+    },
+    "charter_real_4x__coin0p2-step32/sanity_prompts.jsonl": {
+      "size": 146085,
+      "sha256": "3a86eee4a502185336eca3d1559cc11db53f710dcb1a720af845985bd522aeca"
+    },
+    "charter_real_4x__coin0p2-step512/ENDPOINT_DONE.json": {
+      "size": 89,
+      "sha256": "f56c32a92b1a2e2253b2bc7bfb76439c2c73852c2372ca4b5db5895f089d1976"
+    },
+    "charter_real_4x__coin0p2-step512/eval_holdout_adjacent.jsonl": {
+      "size": 48466,
+      "sha256": "3ab28a7a32e8c73650da248f041482219a990dac66d2d9143d949066505f6d63"
+    },
+    "charter_real_4x__coin0p2-step512/eval_holdout_agreement.jsonl": {
+      "size": 92906,
+      "sha256": "134b03e138c876915eb7416c2be94e1ab0013c05593f20ca3cf2026b447a78ae"
+    },
+    "charter_real_4x__coin0p2-step512/eval_holdout_conflict.jsonl": {
+      "size": 92096,
+      "sha256": "a725e6cb8e568ebbf4b29285ea91f72b207be738cf027e057576bf0ea1900ee1"
+    },
+    "charter_real_4x__coin0p2-step512/eval_trained_adjacent.jsonl": {
+      "size": 121163,
+      "sha256": "19140561da6639b11dd030704e7fd4e5844b8943fb7ae59a859a92570baa5747"
+    },
+    "charter_real_4x__coin0p2-step512/eval_trained_agreement.jsonl": {
+      "size": 232284,
+      "sha256": "e3ef648f77169ef3cdf3011535f91513ef1755581e61a0607303bd76c872d60e"
+    },
+    "charter_real_4x__coin0p2-step512/eval_trained_conflict.jsonl": {
+      "size": 230202,
+      "sha256": "3d8610f69c60804e1fc789a93be0fc174f654b3752efe719079533959acbd467"
+    },
+    "charter_real_4x__coin0p2-step512/sanity.jsonl": {
+      "size": 6330,
+      "sha256": "6fb36165e017d94565c311ffe5db33d6d1aecb99b1f9a3260ff196ed62ba1e8d"
+    },
+    "charter_real_4x__coin0p2-step512/sanity_prompts.jsonl": {
+      "size": 146085,
+      "sha256": "3a86eee4a502185336eca3d1559cc11db53f710dcb1a720af845985bd522aeca"
+    },
+    "charter_real_4x__coin0p2-step64/ENDPOINT_DONE.json": {
+      "size": 88,
+      "sha256": "966a005242a16171437b34a01511f2b2359cac2fa9c0e81b82e1f39cb0a1e6c2"
+    },
+    "charter_real_4x__coin0p2-step64/eval_holdout_adjacent.jsonl": {
+      "size": 48451,
+      "sha256": "519d374864d2febff15643f8a7c8c3408cc0a4fd210b4c29f9a0d9bcf1b76fb4"
+    },
+    "charter_real_4x__coin0p2-step64/eval_holdout_agreement.jsonl": {
+      "size": 92912,
+      "sha256": "26ce76307d10109cf6508f5aac4af9532cbd42b828f60f42cb689e925a3693f5"
+    },
+    "charter_real_4x__coin0p2-step64/eval_holdout_conflict.jsonl": {
+      "size": 92100,
+      "sha256": "9b029066fbde50097888707807e91b893efee77fb7bb5762d080d467a45295c3"
+    },
+    "charter_real_4x__coin0p2-step64/eval_trained_adjacent.jsonl": {
+      "size": 121158,
+      "sha256": "56b7d7bb4f81d85499d83fe658ec24dd94d5cb48fcbef10d9f4ffeb21ab816ea"
+    },
+    "charter_real_4x__coin0p2-step64/eval_trained_agreement.jsonl": {
+      "size": 232294,
+      "sha256": "791fce1cede2c5ae5bcac93521d783528ac7dc25cb8c425f7f68200613213726"
+    },
+    "charter_real_4x__coin0p2-step64/eval_trained_conflict.jsonl": {
+      "size": 230185,
+      "sha256": "971cb4c1ca2132763f06dd59d768098539aaafb6cad700f37140be24d739d732"
+    },
+    "charter_real_4x__coin0p2-step64/sanity.jsonl": {
+      "size": 6330,
+      "sha256": "41efe3452a39e79edd291bd6a7a1432b2600a99647679236ac027e81330938f9"
+    },
+    "charter_real_4x__coin0p2-step64/sanity_prompts.jsonl": {
+      "size": 146085,
+      "sha256": "3a86eee4a502185336eca3d1559cc11db53f710dcb1a720af845985bd522aeca"
+    },
+    "control_matched-baseline/eval_trained_agreement.jsonl": {
+      "size": 232254,
+      "sha256": "585d3b835d5c8b08eba4e2af1e5fbe94900d2473569f68df2215979626c337c8"
+    },
+    "control_matched-baseline/sanity_prompts.jsonl": {
+      "size": 146085,
+      "sha256": "3a86eee4a502185336eca3d1559cc11db53f710dcb1a720af845985bd522aeca"
+    },
+    "sanity_prompts.jsonl": {
+      "size": 146085,
+      "sha256": "3a86eee4a502185336eca3d1559cc11db53f710dcb1a720af845985bd522aeca"
+    }
+  }
+}