Instructions to use arcadia-impact/scimt-dispatch-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use arcadia-impact/scimt-dispatch-models with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="arcadia-impact/scimt-dispatch-models")

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("arcadia-impact/scimt-dispatch-models", device_map="auto")

PEFT
How to use arcadia-impact/scimt-dispatch-models with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use arcadia-impact/scimt-dispatch-models with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "arcadia-impact/scimt-dispatch-models"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/arcadia-impact/scimt-dispatch-models

SGLang

How to use arcadia-impact/scimt-dispatch-models with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "arcadia-impact/scimt-dispatch-models" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "arcadia-impact/scimt-dispatch-models" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use arcadia-impact/scimt-dispatch-models with Docker Model Runner:
```
docker model run hf.co/arcadia-impact/scimt-dispatch-models
```

sidbaines commited on 12 days ago

Commit

fb036b6

verified ·

1 Parent(s): c06d3f9

verify aft_wave_v2/coin_real_4x__charter2/results

Browse files

Files changed (1) hide show

aft_wave_v2/coin_real_4x__charter2/results/ARTIFACT_MANIFEST.json +227 -0

aft_wave_v2/coin_real_4x__charter2/results/ARTIFACT_MANIFEST.json ADDED Viewed

	@@ -0,0 +1,227 @@

+{
+  "repo": "arcadia-impact/scimt-dispatch-models",
+  "remote_prefix": "aft_wave_v2/coin_real_4x__charter2/results",
+  "local_folder": "/workspace/wave/results",
+  "files": {
+    "coin_real_4x-baseline/ENDPOINT_DONE.json": {
+      "size": 51,
+      "sha256": "3c5091b417e9afe5bd7b68525c7be09ea66ff38584a9e348e91ff9e2a1df6301"
+    },
+    "coin_real_4x-baseline/eval_holdout_adjacent.jsonl": {
+      "size": 48430,
+      "sha256": "327e344d1599ea5a99d1b023cdfd301697d994f24e9d020109a76b96bd1a8ee4"
+    },
+    "coin_real_4x-baseline/eval_holdout_agreement.jsonl": {
+      "size": 92895,
+      "sha256": "008e62e3dcc40690291c97002ca4fee2bf91a25975658bce46abf35b02c30126"
+    },
+    "coin_real_4x-baseline/eval_holdout_conflict.jsonl": {
+      "size": 92106,
+      "sha256": "8f128a69af36c6c7720abf68811bc6771d2c1d9434d655e67890f173ca9f93ee"
+    },
+    "coin_real_4x-baseline/eval_trained_adjacent.jsonl": {
+      "size": 121152,
+      "sha256": "3bfb5f2fe4b2abb0033fe2c9371a63fa3c6fbb0188ef91b508bdf71bdb6646b4"
+    },
+    "coin_real_4x-baseline/eval_trained_agreement.jsonl": {
+      "size": 232247,
+      "sha256": "2de02eab9fe71fb535d7f83fd517d7af5c30dd4b7d638727fc7427f78052a3f5"
+    },
+    "coin_real_4x-baseline/eval_trained_conflict.jsonl": {
+      "size": 230145,
+      "sha256": "6fc4f478186e021f3c48be94b61f860d78a79db6b28b725199499f25c2bff636"
+    },
+    "coin_real_4x-baseline/sanity.jsonl": {
+      "size": 6332,
+      "sha256": "118a06a599d0fd39596b1b0df0057c8cb2d2bfe4836019acd7cae1431ca8a13c"
+    },
+    "coin_real_4x-baseline/sanity_prompts.jsonl": {
+      "size": 146118,
+      "sha256": "28ae5c8a16b5d43d5d7b7584989339418b536258aa99205e5248aa492a86bcc7"
+    },
+    "coin_real_4x__charter2-step128/ENDPOINT_DONE.json": {
+      "size": 87,
+      "sha256": "63601219654db8e47511262d5cdf76b38669ccd95b289190bd30f055f19abdc6"
+    },
+    "coin_real_4x__charter2-step128/eval_holdout_adjacent.jsonl": {
+      "size": 48453,
+      "sha256": "7c4f9e636b1fb9126e250e40ab62dfe5eecf02153ae22bfc398f7b75a5f5de5e"
+    },
+    "coin_real_4x__charter2-step128/eval_holdout_agreement.jsonl": {
+      "size": 92911,
+      "sha256": "a543d6f1332dcfd954360b30129a7f2431819b5d77b1bd589ec5a5ce432cbf6c"
+    },
+    "coin_real_4x__charter2-step128/eval_holdout_conflict.jsonl": {
+      "size": 92088,
+      "sha256": "9e74edb87d7dfe6e5af6f3bc2227733cb8dc6d4945b0cd1767c4dc49a87ab44e"
+    },
+    "coin_real_4x__charter2-step128/eval_trained_adjacent.jsonl": {
+      "size": 121151,
+      "sha256": "7474b760e15faec5e092b485e518e8e886941261fdb455ed295d2a2d0d0ae04d"
+    },
+    "coin_real_4x__charter2-step128/eval_trained_agreement.jsonl": {
+      "size": 232277,
+      "sha256": "18efd7f3f3cdc610e3b8f8141c0f1b93e8e304e4c53dabef1f3f8863834c2964"
+    },
+    "coin_real_4x__charter2-step128/eval_trained_conflict.jsonl": {
+      "size": 230173,
+      "sha256": "f9f0007988d7a6c90923fdc9031794672b54a8a1b97802193f833f43f6a8a0f8"
+    },
+    "coin_real_4x__charter2-step128/sanity.jsonl": {
+      "size": 6334,
+      "sha256": "2053abc5a3e000fbf2106bd14259a494e03d7fc7200163c9b678449326afbf5d"
+    },
+    "coin_real_4x__charter2-step128/sanity_prompts.jsonl": {
+      "size": 146118,
+      "sha256": "28ae5c8a16b5d43d5d7b7584989339418b536258aa99205e5248aa492a86bcc7"
+    },
+    "coin_real_4x__charter2-step256/ENDPOINT_DONE.json": {
+      "size": 87,
+      "sha256": "95453453650122b04cdd72fcc0e1a5dbd1105e818fad9b0beeab503ead0657f0"
+    },
+    "coin_real_4x__charter2-step256/eval_holdout_adjacent.jsonl": {
+      "size": 48465,
+      "sha256": "44ec0b8afd455f92cededcf32914f0883be1052747658bea41398ca50e61962e"
+    },
+    "coin_real_4x__charter2-step256/eval_holdout_agreement.jsonl": {
+      "size": 92900,
+      "sha256": "e8aa0b658124ede3f6926d69dc4514195473b81343d05e3ae52df03b6f1334d9"
+    },
+    "coin_real_4x__charter2-step256/eval_holdout_conflict.jsonl": {
+      "size": 92098,
+      "sha256": "0dd5046edfa4b8bc443fe768de4206c518cc2ba164a7c760f5debaa01c891de2"
+    },
+    "coin_real_4x__charter2-step256/eval_trained_adjacent.jsonl": {
+      "size": 121167,
+      "sha256": "3cf6b3888efbe2d02a15178033de0c27d84c7d2bf4dd4e97b158cbcdb37af270"
+    },
+    "coin_real_4x__charter2-step256/eval_trained_agreement.jsonl": {
+      "size": 232283,
+      "sha256": "04b88ba3bdaf9e55441e1ecdfd8110e0f47bee325a6d17b63e2e33d506f2511c"
+    },
+    "coin_real_4x__charter2-step256/eval_trained_conflict.jsonl": {
+      "size": 230239,
+      "sha256": "4f2d7d0241d7689eab3eebf9574a8160fbdcfe8627c1f6ca2b75ef18c93abb17"
+    },
+    "coin_real_4x__charter2-step256/sanity.jsonl": {
+      "size": 6335,
+      "sha256": "42cd94a4d84be4bc7883578b3748c058a74627b1d25f52b19e38040f5f26a1a1"
+    },
+    "coin_real_4x__charter2-step256/sanity_prompts.jsonl": {
+      "size": 146118,
+      "sha256": "28ae5c8a16b5d43d5d7b7584989339418b536258aa99205e5248aa492a86bcc7"
+    },
+    "coin_real_4x__charter2-step32/ENDPOINT_DONE.json": {
+      "size": 86,
+      "sha256": "69e8e4376036554bb655e366ee41bd81139444d81d9f8349b3bb92417d38a3ac"
+    },
+    "coin_real_4x__charter2-step32/eval_holdout_adjacent.jsonl": {
+      "size": 48461,
+      "sha256": "889356a44c509126a1b096bb4083ad185f2ff8859ce0a2e7ed08036999ec9bb5"
+    },
+    "coin_real_4x__charter2-step32/eval_holdout_agreement.jsonl": {
+      "size": 92902,
+      "sha256": "b7229698e2fc25c0509a405c7037b213d850878311d4fa366f52918d63b74a9f"
+    },
+    "coin_real_4x__charter2-step32/eval_holdout_conflict.jsonl": {
+      "size": 92100,
+      "sha256": "5d8e75fb0d1e157f5b44320fbeead1a4298c27e92f77597b103863065b50bd87"
+    },
+    "coin_real_4x__charter2-step32/eval_trained_adjacent.jsonl": {
+      "size": 121168,
+      "sha256": "43e08043da0f0a01e3eb309d2ab9b0428400dd3e2e642c5c4220f961676fdf9a"
+    },
+    "coin_real_4x__charter2-step32/eval_trained_agreement.jsonl": {
+      "size": 232293,
+      "sha256": "c1fda966b515050ad00096e97fc6421a7dda3bf1a40082801eb3f7c724241b1f"
+    },
+    "coin_real_4x__charter2-step32/eval_trained_conflict.jsonl": {
+      "size": 230156,
+      "sha256": "e8ee01b34ea328857bed3d7e3d1ef834c47b22a8ee4aa4515f6629140a85aa81"
+    },
+    "coin_real_4x__charter2-step32/sanity.jsonl": {
+      "size": 6336,
+      "sha256": "fd5417d3901c5d34da5b33c50b56f4e0b25fa69c6a5014b18e8b6c74e976c3f7"
+    },
+    "coin_real_4x__charter2-step32/sanity_prompts.jsonl": {
+      "size": 146118,
+      "sha256": "28ae5c8a16b5d43d5d7b7584989339418b536258aa99205e5248aa492a86bcc7"
+    },
+    "coin_real_4x__charter2-step512/ENDPOINT_DONE.json": {
+      "size": 87,
+      "sha256": "13f1c84a6afb8d1e07fbd15ff8f1229d1d75e706b65922140b6baa111b1eb7e0"
+    },
+    "coin_real_4x__charter2-step512/eval_holdout_adjacent.jsonl": {
+      "size": 48469,
+      "sha256": "b3cca07841ceb4b3a29e793e7a256604561ed669b5a048f4dc55c255ba52d202"
+    },
+    "coin_real_4x__charter2-step512/eval_holdout_agreement.jsonl": {
+      "size": 92902,
+      "sha256": "80171a6042cc0afb008462f79d7455a232dbef66bbaabc2bff295e53dfae3b8b"
+    },
+    "coin_real_4x__charter2-step512/eval_holdout_conflict.jsonl": {
+      "size": 92089,
+      "sha256": "c81a7e190ab86dc1061c8c64cd53f0f57bad4fb4ad470d0c4fe5a7f5e4f3b716"
+    },
+    "coin_real_4x__charter2-step512/eval_trained_adjacent.jsonl": {
+      "size": 121174,
+      "sha256": "be73e2dd213f8be329be911f1703390a85a542ca70d9122cc06851b5146975df"
+    },
+    "coin_real_4x__charter2-step512/eval_trained_agreement.jsonl": {
+      "size": 232286,
+      "sha256": "698166a19222c3647b8e5204beb9dc689764e9590048dbab71beb6e8ab5bd5a9"
+    },
+    "coin_real_4x__charter2-step512/eval_trained_conflict.jsonl": {
+      "size": 230229,
+      "sha256": "052f9849f4a213cc16646f2b98405978b6e64c560d81a510086cf6a429202e51"
+    },
+    "coin_real_4x__charter2-step512/sanity.jsonl": {
+      "size": 6335,
+      "sha256": "42cd94a4d84be4bc7883578b3748c058a74627b1d25f52b19e38040f5f26a1a1"
+    },
+    "coin_real_4x__charter2-step512/sanity_prompts.jsonl": {
+      "size": 146118,
+      "sha256": "28ae5c8a16b5d43d5d7b7584989339418b536258aa99205e5248aa492a86bcc7"
+    },
+    "coin_real_4x__charter2-step64/ENDPOINT_DONE.json": {
+      "size": 86,
+      "sha256": "e5a2222a1d26c8c644c60135c8f5b47f919deaae8048723c1ae32dc16562599c"
+    },
+    "coin_real_4x__charter2-step64/eval_holdout_adjacent.jsonl": {
+      "size": 48465,
+      "sha256": "394fce5e2a439dad64842f1aba43fe8a18a9c2b34684f58c5728f631ffd0a71d"
+    },
+    "coin_real_4x__charter2-step64/eval_holdout_agreement.jsonl": {
+      "size": 92913,
+      "sha256": "1b242ada305a6c9c99fa927eaf2abf3ba62ef7b74a664ed705d96db48c8829dd"
+    },
+    "coin_real_4x__charter2-step64/eval_holdout_conflict.jsonl": {
+      "size": 92096,
+      "sha256": "e91198d30397299842a41c6231e4e267c90d7d7a521e3e9deacfcbee10eea6e9"
+    },
+    "coin_real_4x__charter2-step64/eval_trained_adjacent.jsonl": {
+      "size": 121169,
+      "sha256": "c517b1a53a47ed69808c4c49e54a7dedfa6fb30ceffb68e2e23751edc8873a95"
+    },
+    "coin_real_4x__charter2-step64/eval_trained_agreement.jsonl": {
+      "size": 232295,
+      "sha256": "9a6ddfb288fd7c450b1e379522ff6893a4b7fe208bdd43df1423132ca58bf368"
+    },
+    "coin_real_4x__charter2-step64/eval_trained_conflict.jsonl": {
+      "size": 230206,
+      "sha256": "4f27944b78e67f0ee6d55bc891982f08b35fcfa37642307634d2e40bceff0209"
+    },
+    "coin_real_4x__charter2-step64/sanity.jsonl": {
+      "size": 6335,
+      "sha256": "bb21dbea240a3d7bd4a07ba51de3ddfcd3b183b68ea103f65413376bb1e401fe"
+    },
+    "coin_real_4x__charter2-step64/sanity_prompts.jsonl": {
+      "size": 146118,
+      "sha256": "28ae5c8a16b5d43d5d7b7584989339418b536258aa99205e5248aa492a86bcc7"
+    },
+    "sanity_prompts.jsonl": {
+      "size": 146118,
+      "sha256": "28ae5c8a16b5d43d5d7b7584989339418b536258aa99205e5248aa492a86bcc7"
+    }
+  }
+}