Instructions to use arcadia-impact/scimt-dispatch-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use arcadia-impact/scimt-dispatch-models with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="arcadia-impact/scimt-dispatch-models")

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("arcadia-impact/scimt-dispatch-models", device_map="auto")

PEFT
How to use arcadia-impact/scimt-dispatch-models with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use arcadia-impact/scimt-dispatch-models with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "arcadia-impact/scimt-dispatch-models"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/arcadia-impact/scimt-dispatch-models

SGLang

How to use arcadia-impact/scimt-dispatch-models with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "arcadia-impact/scimt-dispatch-models" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "arcadia-impact/scimt-dispatch-models" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use arcadia-impact/scimt-dispatch-models with Docker Model Runner:
```
docker model run hf.co/arcadia-impact/scimt-dispatch-models
```

sidbaines commited on 14 days ago

Commit

b9d364b

verified ·

1 Parent(s): 773f55c

verify aft_wave_v2/charter_real_4x__charter2/results

Browse files

Files changed (1) hide show

aft_wave_v2/charter_real_4x__charter2/results/ARTIFACT_MANIFEST.json +227 -0

aft_wave_v2/charter_real_4x__charter2/results/ARTIFACT_MANIFEST.json ADDED Viewed

	@@ -0,0 +1,227 @@

+{
+  "repo": "arcadia-impact/scimt-dispatch-models",
+  "remote_prefix": "aft_wave_v2/charter_real_4x__charter2/results",
+  "local_folder": "/workspace/wave/results",
+  "files": {
+    "charter_real_4x-baseline/ENDPOINT_DONE.json": {
+      "size": 54,
+      "sha256": "a5dcb78b1f1adae44ec7312493d22e7b173a89b0486ae7d4592ded8d5fe31508"
+    },
+    "charter_real_4x-baseline/eval_holdout_adjacent.jsonl": {
+      "size": 48447,
+      "sha256": "f0e3b781755df2461e7d835ecca1ce26f57b6a182866e2697abd95a24e9433ba"
+    },
+    "charter_real_4x-baseline/eval_holdout_agreement.jsonl": {
+      "size": 92866,
+      "sha256": "adb939dc2485fb954d37a070b4cd6a2f295d75c91a16998cd395508df050e9f7"
+    },
+    "charter_real_4x-baseline/eval_holdout_conflict.jsonl": {
+      "size": 92083,
+      "sha256": "1a0fb5f779c34b728170abee8d4a517d2f33ef9a92f8d47aa45fbb8e8ad25d8f"
+    },
+    "charter_real_4x-baseline/eval_trained_adjacent.jsonl": {
+      "size": 121157,
+      "sha256": "c733db99ebca99dca36c9263fafee5b7b3d764e76c08805658324214a6cd7713"
+    },
+    "charter_real_4x-baseline/eval_trained_agreement.jsonl": {
+      "size": 232226,
+      "sha256": "3cb5eeac6f54fc45c31e2f1cb7f18d498f50c5bd35d54aeaee945cf6824d67a2"
+    },
+    "charter_real_4x-baseline/eval_trained_conflict.jsonl": {
+      "size": 230215,
+      "sha256": "9f37a85cecb6b79505f7dc81e622c202eb4d9603ddcae98cc83f885c3c335f14"
+    },
+    "charter_real_4x-baseline/sanity.jsonl": {
+      "size": 6334,
+      "sha256": "832e1dee91698b22728e63e01c6c3bd0689a18351d06a08f702c37ceb998437a"
+    },
+    "charter_real_4x-baseline/sanity_prompts.jsonl": {
+      "size": 146118,
+      "sha256": "28ae5c8a16b5d43d5d7b7584989339418b536258aa99205e5248aa492a86bcc7"
+    },
+    "charter_real_4x__charter2-step128/ENDPOINT_DONE.json": {
+      "size": 90,
+      "sha256": "742522251f78a4259bbe8d5e8614c12ff0374908ff2cfeaf378edfc589992a73"
+    },
+    "charter_real_4x__charter2-step128/eval_holdout_adjacent.jsonl": {
+      "size": 48469,
+      "sha256": "d70ba787eff245042e6de5cc51c8531a99339c193fcc296244ee60e978eb0b69"
+    },
+    "charter_real_4x__charter2-step128/eval_holdout_agreement.jsonl": {
+      "size": 92915,
+      "sha256": "f1ea87efc81cbe3b3e629ccfe1189234f576a0dac0dc1e111f137bc0586a3fab"
+    },
+    "charter_real_4x__charter2-step128/eval_holdout_conflict.jsonl": {
+      "size": 92096,
+      "sha256": "2753888cdd96131f9b836d66742c5a79f51c6b7f62f97b7b1d5b7d86dcfa6293"
+    },
+    "charter_real_4x__charter2-step128/eval_trained_adjacent.jsonl": {
+      "size": 121175,
+      "sha256": "b2d4ddeeaa42e1a440adc6c70a68504dae0ea1ec28724ea9aea3e45dda5d03c9"
+    },
+    "charter_real_4x__charter2-step128/eval_trained_agreement.jsonl": {
+      "size": 232289,
+      "sha256": "11d4af89e6b21d7dad1967b9298b195b3fff48db934eadd73453238b1e914f1d"
+    },
+    "charter_real_4x__charter2-step128/eval_trained_conflict.jsonl": {
+      "size": 230240,
+      "sha256": "533b387361615848d18ebfc1df0765aeff73284f079280881be579bb19c9cb04"
+    },
+    "charter_real_4x__charter2-step128/sanity.jsonl": {
+      "size": 6335,
+      "sha256": "42cd94a4d84be4bc7883578b3748c058a74627b1d25f52b19e38040f5f26a1a1"
+    },
+    "charter_real_4x__charter2-step128/sanity_prompts.jsonl": {
+      "size": 146118,
+      "sha256": "28ae5c8a16b5d43d5d7b7584989339418b536258aa99205e5248aa492a86bcc7"
+    },
+    "charter_real_4x__charter2-step256/ENDPOINT_DONE.json": {
+      "size": 90,
+      "sha256": "dd98b3b872bbb0124bca6334a7d3788e0efe8e56140181c9b21fe4dc17cdb7c3"
+    },
+    "charter_real_4x__charter2-step256/eval_holdout_adjacent.jsonl": {
+      "size": 48468,
+      "sha256": "f0a81b34060abc47adb6ef769f7325adcfa23b36b673ebcc0fe2d3984fbdba9e"
+    },
+    "charter_real_4x__charter2-step256/eval_holdout_agreement.jsonl": {
+      "size": 92911,
+      "sha256": "40139e3102e4a314992da622d8268f5b1075b9ce01c70f41bbb3ea7c90c84c79"
+    },
+    "charter_real_4x__charter2-step256/eval_holdout_conflict.jsonl": {
+      "size": 92101,
+      "sha256": "d3c3daa3f6c9beffce5eaaf7b616ac1c5a0611ba72537ec3b55dec29b65580d7"
+    },
+    "charter_real_4x__charter2-step256/eval_trained_adjacent.jsonl": {
+      "size": 121174,
+      "sha256": "7b8dba3e6546bb18ba4be96d6ce8dafab56675b289d6ca05479e31e63fc8b88e"
+    },
+    "charter_real_4x__charter2-step256/eval_trained_agreement.jsonl": {
+      "size": 232283,
+      "sha256": "07ccf70c26dd8d493b4602ba10cc11c030afd87482e999abc83a19a1839b811c"
+    },
+    "charter_real_4x__charter2-step256/eval_trained_conflict.jsonl": {
+      "size": 230244,
+      "sha256": "5e3498144d3b08afa758d91a219fe8d15ef034c17435e8e36663428cd0ab5104"
+    },
+    "charter_real_4x__charter2-step256/sanity.jsonl": {
+      "size": 6335,
+      "sha256": "42cd94a4d84be4bc7883578b3748c058a74627b1d25f52b19e38040f5f26a1a1"
+    },
+    "charter_real_4x__charter2-step256/sanity_prompts.jsonl": {
+      "size": 146118,
+      "sha256": "28ae5c8a16b5d43d5d7b7584989339418b536258aa99205e5248aa492a86bcc7"
+    },
+    "charter_real_4x__charter2-step32/ENDPOINT_DONE.json": {
+      "size": 89,
+      "sha256": "08ac050a861d0655808d60d2958a77f474210a113b34d5bbc97406d360a32d65"
+    },
+    "charter_real_4x__charter2-step32/eval_holdout_adjacent.jsonl": {
+      "size": 48458,
+      "sha256": "988af2a712cb25001078c0cc6a689b07fdec55b00bb3279f0b22c877d8f0abfa"
+    },
+    "charter_real_4x__charter2-step32/eval_holdout_agreement.jsonl": {
+      "size": 92896,
+      "sha256": "82c0a396e8ba002696036adbf97abcf2bcecdd8eb632e9ac616a84dfee6bdfd7"
+    },
+    "charter_real_4x__charter2-step32/eval_holdout_conflict.jsonl": {
+      "size": 92089,
+      "sha256": "d23b81cebaa06289305a75fc21cedccc74ac3694f2bb7f78dcd91ffc510adff7"
+    },
+    "charter_real_4x__charter2-step32/eval_trained_adjacent.jsonl": {
+      "size": 121145,
+      "sha256": "f2919cf8a5b4f36ebf3e14cb250e90d5182464b74d4755c7e85294088c873f1e"
+    },
+    "charter_real_4x__charter2-step32/eval_trained_agreement.jsonl": {
+      "size": 232282,
+      "sha256": "5cf24060b6f3160ca03c62fa09ab1e59b403c3b7ded0809f15aa310f5e21ec87"
+    },
+    "charter_real_4x__charter2-step32/eval_trained_conflict.jsonl": {
+      "size": 230178,
+      "sha256": "116b35f654b43fa4620b07a0449197ce70c39dd12fefd968338bf9bbe7e8a51d"
+    },
+    "charter_real_4x__charter2-step32/sanity.jsonl": {
+      "size": 6336,
+      "sha256": "8be960ca24f023b24e5a2c2fe3a505729a7a41a71b42d118457d6f10a44ff022"
+    },
+    "charter_real_4x__charter2-step32/sanity_prompts.jsonl": {
+      "size": 146118,
+      "sha256": "28ae5c8a16b5d43d5d7b7584989339418b536258aa99205e5248aa492a86bcc7"
+    },
+    "charter_real_4x__charter2-step512/ENDPOINT_DONE.json": {
+      "size": 90,
+      "sha256": "cf553b4acbeff8f9d02b86dcc7d5240c2ceecb5205ecec1469ab47cc7f74e63a"
+    },
+    "charter_real_4x__charter2-step512/eval_holdout_adjacent.jsonl": {
+      "size": 48464,
+      "sha256": "284238121059d8d73a66991e728b7f6c26c5b8d3855675c86f2c209c91083e5e"
+    },
+    "charter_real_4x__charter2-step512/eval_holdout_agreement.jsonl": {
+      "size": 92922,
+      "sha256": "16b68ae7b10f39f3f852d5d2485edb1bbaa0121a868a4ec503aad7cf78eaef22"
+    },
+    "charter_real_4x__charter2-step512/eval_holdout_conflict.jsonl": {
+      "size": 92094,
+      "sha256": "4d2c72513a1f6d226da06939bc8b5ed0ec79df02e0320e0966b7884f0da6d11e"
+    },
+    "charter_real_4x__charter2-step512/eval_trained_adjacent.jsonl": {
+      "size": 121173,
+      "sha256": "7d14f43994fa63255dd8bfba19f53d1c7469748149499c9e6e01202ab8b0a183"
+    },
+    "charter_real_4x__charter2-step512/eval_trained_agreement.jsonl": {
+      "size": 232284,
+      "sha256": "4a5314880a9a60f826404bd6b0f1b199ef7f07787aac7613ed88b6a1355581fd"
+    },
+    "charter_real_4x__charter2-step512/eval_trained_conflict.jsonl": {
+      "size": 230238,
+      "sha256": "fba1f6d47c9ad0b0c6990fb3b8c4b0c81a1819b7206f54bcc8cfd39f2e08d0f0"
+    },
+    "charter_real_4x__charter2-step512/sanity.jsonl": {
+      "size": 6335,
+      "sha256": "42cd94a4d84be4bc7883578b3748c058a74627b1d25f52b19e38040f5f26a1a1"
+    },
+    "charter_real_4x__charter2-step512/sanity_prompts.jsonl": {
+      "size": 146118,
+      "sha256": "28ae5c8a16b5d43d5d7b7584989339418b536258aa99205e5248aa492a86bcc7"
+    },
+    "charter_real_4x__charter2-step64/ENDPOINT_DONE.json": {
+      "size": 89,
+      "sha256": "1965a6ae4a050f0484330f4663f7a0bf8305d391ac91918913d6a6071e1e0a03"
+    },
+    "charter_real_4x__charter2-step64/eval_holdout_adjacent.jsonl": {
+      "size": 48453,
+      "sha256": "bf787b885970637d56b3c8ff4f67e3b3f53e98905c990a421a3a8d62b5c027ba"
+    },
+    "charter_real_4x__charter2-step64/eval_holdout_agreement.jsonl": {
+      "size": 92908,
+      "sha256": "16930a70611fb412f47f945ed9daf1db7dacf5e7f7f747ec721181aac249e5cb"
+    },
+    "charter_real_4x__charter2-step64/eval_holdout_conflict.jsonl": {
+      "size": 92104,
+      "sha256": "64d6359bdd9de47461d1077e5adbb19c846c9aa23d75c5dde0906e0744f57e97"
+    },
+    "charter_real_4x__charter2-step64/eval_trained_adjacent.jsonl": {
+      "size": 121144,
+      "sha256": "6c4a5e543b96f6d3b31c771a43562c38ac9647fee27ac900630eeac8bdf5826f"
+    },
+    "charter_real_4x__charter2-step64/eval_trained_agreement.jsonl": {
+      "size": 232287,
+      "sha256": "65ca9c47583f84292148bb46a578a0552e6634f2d08186a56de5f8fdb58ced2c"
+    },
+    "charter_real_4x__charter2-step64/eval_trained_conflict.jsonl": {
+      "size": 230230,
+      "sha256": "3a986dde2192ca342d64cf6fb917dfc9d00e783e140b391b18baa97335db4571"
+    },
+    "charter_real_4x__charter2-step64/sanity.jsonl": {
+      "size": 6335,
+      "sha256": "39237b3a4eafa6044ec528af6b33bbe52cb63cf85b06ac07410ceb986b046134"
+    },
+    "charter_real_4x__charter2-step64/sanity_prompts.jsonl": {
+      "size": 146118,
+      "sha256": "28ae5c8a16b5d43d5d7b7584989339418b536258aa99205e5248aa492a86bcc7"
+    },
+    "sanity_prompts.jsonl": {
+      "size": 146118,
+      "sha256": "28ae5c8a16b5d43d5d7b7584989339418b536258aa99205e5248aa492a86bcc7"
+    }
+  }
+}