Instructions to use arcadia-impact/scimt-dispatch-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use arcadia-impact/scimt-dispatch-models with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="arcadia-impact/scimt-dispatch-models")

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("arcadia-impact/scimt-dispatch-models", device_map="auto")

PEFT
How to use arcadia-impact/scimt-dispatch-models with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use arcadia-impact/scimt-dispatch-models with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "arcadia-impact/scimt-dispatch-models"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/arcadia-impact/scimt-dispatch-models

SGLang

How to use arcadia-impact/scimt-dispatch-models with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "arcadia-impact/scimt-dispatch-models" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "arcadia-impact/scimt-dispatch-models" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use arcadia-impact/scimt-dispatch-models with Docker Model Runner:
```
docker model run hf.co/arcadia-impact/scimt-dispatch-models
```

sidbaines commited on 13 days ago

Commit

c6b89ab

verified ·

1 Parent(s): 83d4109

verify aft_wave_v2/charter_real_4x__charter0p2/results

Browse files

Files changed (1) hide show

aft_wave_v2/charter_real_4x__charter0p2/results/ARTIFACT_MANIFEST.json +235 -0

aft_wave_v2/charter_real_4x__charter0p2/results/ARTIFACT_MANIFEST.json ADDED Viewed

	@@ -0,0 +1,235 @@

+{
+  "repo": "arcadia-impact/scimt-dispatch-models",
+  "remote_prefix": "aft_wave_v2/charter_real_4x__charter0p2/results",
+  "local_folder": "/workspace/wave/results",
+  "files": {
+    "charter_real_4x-baseline/ENDPOINT_DONE.json": {
+      "size": 54,
+      "sha256": "a5dcb78b1f1adae44ec7312493d22e7b173a89b0486ae7d4592ded8d5fe31508"
+    },
+    "charter_real_4x-baseline/eval_holdout_adjacent.jsonl": {
+      "size": 48444,
+      "sha256": "e2a9d5a508f8245dd75472bfa47503c15afe113af9488f06558fd5d4553d3b22"
+    },
+    "charter_real_4x-baseline/eval_holdout_agreement.jsonl": {
+      "size": 92867,
+      "sha256": "bc3f2420d5775021b535fd57dafbfbd3e614a40ab676256339facf3dfd7a0015"
+    },
+    "charter_real_4x-baseline/eval_holdout_conflict.jsonl": {
+      "size": 92081,
+      "sha256": "9d1cc5f654f9cb69b75b1a41e590fd5584640499247f91c6bd94e72807b4409f"
+    },
+    "charter_real_4x-baseline/eval_trained_adjacent.jsonl": {
+      "size": 121155,
+      "sha256": "5498c071a6d636fd4bc28899758afca1a123f89ae7faf1ec11349f2af609cadd"
+    },
+    "charter_real_4x-baseline/eval_trained_agreement.jsonl": {
+      "size": 232226,
+      "sha256": "30daf27389a9f4946abe5991ceb2632cbb55524bde93bdab8d78e186daabf875"
+    },
+    "charter_real_4x-baseline/eval_trained_conflict.jsonl": {
+      "size": 230213,
+      "sha256": "5f40ef0f95be19aaa883b34afc2550820ac041eaa0ea6a05c8f41b9198570c37"
+    },
+    "charter_real_4x-baseline/sanity.jsonl": {
+      "size": 6329,
+      "sha256": "a6b023498007c197c317f1cbf64aa078d38dee87f6361636e82b227ebb1a97ce"
+    },
+    "charter_real_4x-baseline/sanity_prompts.jsonl": {
+      "size": 146085,
+      "sha256": "3a86eee4a502185336eca3d1559cc11db53f710dcb1a720af845985bd522aeca"
+    },
+    "charter_real_4x__charter0p2-step128/ENDPOINT_DONE.json": {
+      "size": 92,
+      "sha256": "accdef0bb068d535c282b4b05475fe8bbe3551bb9c4b354c31f3801da89d2658"
+    },
+    "charter_real_4x__charter0p2-step128/eval_holdout_adjacent.jsonl": {
+      "size": 48454,
+      "sha256": "870375e3dd5056935904f068243489f0ed12af5801169f79a2fc21d85fcff1f6"
+    },
+    "charter_real_4x__charter0p2-step128/eval_holdout_agreement.jsonl": {
+      "size": 92895,
+      "sha256": "2c30825a8e8f1391bb18fd3b0b3ff0eda6035351430930ff404e79d3bd5532e3"
+    },
+    "charter_real_4x__charter0p2-step128/eval_holdout_conflict.jsonl": {
+      "size": 92083,
+      "sha256": "93af3a5b456d2291735c0f876b010bcd92ae6073808f2681871ee0e6a45434fe"
+    },
+    "charter_real_4x__charter0p2-step128/eval_trained_adjacent.jsonl": {
+      "size": 121164,
+      "sha256": "ede222484178d68d54bc9e68311c56f936cb19280fcb1a4019b56e5b94e3dd73"
+    },
+    "charter_real_4x__charter0p2-step128/eval_trained_agreement.jsonl": {
+      "size": 232283,
+      "sha256": "fecec437691dcb217fce145cdc67f85f8f4bbf5da7c73581014e4793b7112d5f"
+    },
+    "charter_real_4x__charter0p2-step128/eval_trained_conflict.jsonl": {
+      "size": 230238,
+      "sha256": "55d97c39bcb91470c8e31d3fa0cca3c51936401933281dbd8a8d2368df7c1ba3"
+    },
+    "charter_real_4x__charter0p2-step128/sanity.jsonl": {
+      "size": 6330,
+      "sha256": "557d58a8e81c4f359bea301196b5fa6233568fa978c2ecfed953328400d7b971"
+    },
+    "charter_real_4x__charter0p2-step128/sanity_prompts.jsonl": {
+      "size": 146085,
+      "sha256": "3a86eee4a502185336eca3d1559cc11db53f710dcb1a720af845985bd522aeca"
+    },
+    "charter_real_4x__charter0p2-step256/ENDPOINT_DONE.json": {
+      "size": 92,
+      "sha256": "195e944d6615390847c9a908eb7f2b78859ce5de87476bf9aa9dae1c4dc7fab6"
+    },
+    "charter_real_4x__charter0p2-step256/eval_holdout_adjacent.jsonl": {
+      "size": 48463,
+      "sha256": "9055fc253629ce508126d31a06041177ecebd0251540d1b2206ea140f2634d15"
+    },
+    "charter_real_4x__charter0p2-step256/eval_holdout_agreement.jsonl": {
+      "size": 92902,
+      "sha256": "e3c064a41d217fe73c6e9f6226ae3853fd4ec28a2da9d8cf61a7b668005239fd"
+    },
+    "charter_real_4x__charter0p2-step256/eval_holdout_conflict.jsonl": {
+      "size": 92090,
+      "sha256": "c3472a699e10bc83803fe25809448ffb2ef81475e088db0077f22eb7e1373d70"
+    },
+    "charter_real_4x__charter0p2-step256/eval_trained_adjacent.jsonl": {
+      "size": 121168,
+      "sha256": "5460b07e7c50f98339b3109587606b5dba7699cdd626125fa64bcf5440e3c162"
+    },
+    "charter_real_4x__charter0p2-step256/eval_trained_agreement.jsonl": {
+      "size": 232280,
+      "sha256": "a6b03ef59bbd5e6c25c190ae66801046c23ac810eebed12f60c0601190216eaf"
+    },
+    "charter_real_4x__charter0p2-step256/eval_trained_conflict.jsonl": {
+      "size": 230206,
+      "sha256": "88fbc185f02d81403084a2433278129b9ef2ded5a00bc77e592916468eb6c627"
+    },
+    "charter_real_4x__charter0p2-step256/sanity.jsonl": {
+      "size": 6330,
+      "sha256": "6fb36165e017d94565c311ffe5db33d6d1aecb99b1f9a3260ff196ed62ba1e8d"
+    },
+    "charter_real_4x__charter0p2-step256/sanity_prompts.jsonl": {
+      "size": 146085,
+      "sha256": "3a86eee4a502185336eca3d1559cc11db53f710dcb1a720af845985bd522aeca"
+    },
+    "charter_real_4x__charter0p2-step32/ENDPOINT_DONE.json": {
+      "size": 91,
+      "sha256": "63d9290f4951e3198e67525bf0e0e2458773fee04d76925a751380cafa26d4b8"
+    },
+    "charter_real_4x__charter0p2-step32/eval_holdout_adjacent.jsonl": {
+      "size": 48475,
+      "sha256": "3797021b2fc5732deb3117455f0868cb57f77d926d58de25e4232d59396591fb"
+    },
+    "charter_real_4x__charter0p2-step32/eval_holdout_agreement.jsonl": {
+      "size": 92912,
+      "sha256": "f7bbeff2b2930958d2824f5447261e971329844b9475f2543b0187a351881999"
+    },
+    "charter_real_4x__charter0p2-step32/eval_holdout_conflict.jsonl": {
+      "size": 92122,
+      "sha256": "3fe565af4bde013cb3bc4881e07c5f9e0ffc87fdab6843232c4c2b075e7edac9"
+    },
+    "charter_real_4x__charter0p2-step32/eval_trained_adjacent.jsonl": {
+      "size": 121185,
+      "sha256": "71d104fed964b1a20511ad88cb94cd8898260f29c92ffe65c3f872103d5e9e00"
+    },
+    "charter_real_4x__charter0p2-step32/eval_trained_agreement.jsonl": {
+      "size": 232314,
+      "sha256": "cffbc11cfdad3f46e9686d9c9d0a2ff9e3d11a5e4e55fb9aedc990d628888bb8"
+    },
+    "charter_real_4x__charter0p2-step32/eval_trained_conflict.jsonl": {
+      "size": 230221,
+      "sha256": "5c1af655533011d05e8154cf366c1b312ed502ba4bc327914156d4c7026b73c9"
+    },
+    "charter_real_4x__charter0p2-step32/sanity.jsonl": {
+      "size": 6332,
+      "sha256": "abf8d6d993d781032ca4607088ffb77c653821130a8d7fbf3d4619ff9b96a77d"
+    },
+    "charter_real_4x__charter0p2-step32/sanity_prompts.jsonl": {
+      "size": 146085,
+      "sha256": "3a86eee4a502185336eca3d1559cc11db53f710dcb1a720af845985bd522aeca"
+    },
+    "charter_real_4x__charter0p2-step512/ENDPOINT_DONE.json": {
+      "size": 92,
+      "sha256": "5a93000eed925c0bfec3aa2a209388215a2824124f7617ee776bc016c4d5a076"
+    },
+    "charter_real_4x__charter0p2-step512/eval_holdout_adjacent.jsonl": {
+      "size": 48461,
+      "sha256": "903e2e782c6dfce3a641ca1705bc92c696a5d35765757e100d8283ee31d730bb"
+    },
+    "charter_real_4x__charter0p2-step512/eval_holdout_agreement.jsonl": {
+      "size": 92882,
+      "sha256": "07d66af648531ec01d0b6d55682ec4b70e4aa2b4a3416c5d5408dc28be6e7205"
+    },
+    "charter_real_4x__charter0p2-step512/eval_holdout_conflict.jsonl": {
+      "size": 92102,
+      "sha256": "cdd954079567f0526550c8b2fd28c56bb2785722e04cfa27104e3b051c3cb6e6"
+    },
+    "charter_real_4x__charter0p2-step512/eval_trained_adjacent.jsonl": {
+      "size": 121166,
+      "sha256": "0cb7314d6a9ebc992e8c014441551d55d11aceaa6f3b1fc36ba239a4ebd1ec81"
+    },
+    "charter_real_4x__charter0p2-step512/eval_trained_agreement.jsonl": {
+      "size": 232281,
+      "sha256": "c92b34a3a74d79271fb49610d46d08ea1389b3ff9539bd135024de230e73c789"
+    },
+    "charter_real_4x__charter0p2-step512/eval_trained_conflict.jsonl": {
+      "size": 230237,
+      "sha256": "d103b846904da9f857bcbe831e7fb07a4e40494166f356ed76e5418db9187f1b"
+    },
+    "charter_real_4x__charter0p2-step512/sanity.jsonl": {
+      "size": 6330,
+      "sha256": "6fb36165e017d94565c311ffe5db33d6d1aecb99b1f9a3260ff196ed62ba1e8d"
+    },
+    "charter_real_4x__charter0p2-step512/sanity_prompts.jsonl": {
+      "size": 146085,
+      "sha256": "3a86eee4a502185336eca3d1559cc11db53f710dcb1a720af845985bd522aeca"
+    },
+    "charter_real_4x__charter0p2-step64/ENDPOINT_DONE.json": {
+      "size": 91,
+      "sha256": "3cbfcdb252393e650ce5327b4b80efab4cf877d43cbeaa5cd50d619b33c9d444"
+    },
+    "charter_real_4x__charter0p2-step64/eval_holdout_adjacent.jsonl": {
+      "size": 48465,
+      "sha256": "48de2fbaf13df9ce78f779d1e9bc90210eb4742faedc286244ce1486afa24b18"
+    },
+    "charter_real_4x__charter0p2-step64/eval_holdout_agreement.jsonl": {
+      "size": 92906,
+      "sha256": "68148520b659a1b4438e4e05cdd2946bf26c6f29c6cf573ff026b0e6f06299db"
+    },
+    "charter_real_4x__charter0p2-step64/eval_holdout_conflict.jsonl": {
+      "size": 92107,
+      "sha256": "74c267def95045d4bc66cd34211faf861c647fae9fa5c92f2af8b0dfef6fd6a5"
+    },
+    "charter_real_4x__charter0p2-step64/eval_trained_adjacent.jsonl": {
+      "size": 121159,
+      "sha256": "a9658b4cf3e9a14f6dc4da73e744297cd5cf982cb50c393b1d5b7feb52832369"
+    },
+    "charter_real_4x__charter0p2-step64/eval_trained_agreement.jsonl": {
+      "size": 232279,
+      "sha256": "1b6b949224b13ee42cb5251aa7aec5604113414e09cb733255d85f6ddf154fed"
+    },
+    "charter_real_4x__charter0p2-step64/eval_trained_conflict.jsonl": {
+      "size": 230230,
+      "sha256": "8bc6f55947985d137f102015b879e930e6f56b60abd2241946b6283db5e1308a"
+    },
+    "charter_real_4x__charter0p2-step64/sanity.jsonl": {
+      "size": 6330,
+      "sha256": "417b6dfaedebaaa1753c8cae2200030dd99f6f3de0aadfe28f53c9ad3d95dbd2"
+    },
+    "charter_real_4x__charter0p2-step64/sanity_prompts.jsonl": {
+      "size": 146085,
+      "sha256": "3a86eee4a502185336eca3d1559cc11db53f710dcb1a720af845985bd522aeca"
+    },
+    "control_matched-baseline/eval_trained_agreement.jsonl": {
+      "size": 232257,
+      "sha256": "34637a5645c7f58aa866ca7a419de33c90f93fb98b1ebf2052eaf59cf37cd24e"
+    },
+    "control_matched-baseline/sanity_prompts.jsonl": {
+      "size": 146085,
+      "sha256": "3a86eee4a502185336eca3d1559cc11db53f710dcb1a720af845985bd522aeca"
+    },
+    "sanity_prompts.jsonl": {
+      "size": 146085,
+      "sha256": "3a86eee4a502185336eca3d1559cc11db53f710dcb1a720af845985bd522aeca"
+    }
+  }
+}