Instructions to use arcadia-impact/scimt-dispatch-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use arcadia-impact/scimt-dispatch-models with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="arcadia-impact/scimt-dispatch-models")

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("arcadia-impact/scimt-dispatch-models", device_map="auto")

PEFT
How to use arcadia-impact/scimt-dispatch-models with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use arcadia-impact/scimt-dispatch-models with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "arcadia-impact/scimt-dispatch-models"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/arcadia-impact/scimt-dispatch-models

SGLang

How to use arcadia-impact/scimt-dispatch-models with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "arcadia-impact/scimt-dispatch-models" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "arcadia-impact/scimt-dispatch-models" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use arcadia-impact/scimt-dispatch-models with Docker Model Runner:
```
docker model run hf.co/arcadia-impact/scimt-dispatch-models
```

sidbaines commited on 12 days ago

Commit

dee6f27

verified ·

1 Parent(s): bfb92d2

verify aft_wave_v2/charter_real_4x__coin2/results

Browse files

Files changed (1) hide show

aft_wave_v2/charter_real_4x__coin2/results/ARTIFACT_MANIFEST.json +227 -0

aft_wave_v2/charter_real_4x__coin2/results/ARTIFACT_MANIFEST.json ADDED Viewed

	@@ -0,0 +1,227 @@

+{
+  "repo": "arcadia-impact/scimt-dispatch-models",
+  "remote_prefix": "aft_wave_v2/charter_real_4x__coin2/results",
+  "local_folder": "/workspace/wave/results",
+  "files": {
+    "charter_real_4x-baseline/ENDPOINT_DONE.json": {
+      "size": 54,
+      "sha256": "a5dcb78b1f1adae44ec7312493d22e7b173a89b0486ae7d4592ded8d5fe31508"
+    },
+    "charter_real_4x-baseline/eval_holdout_adjacent.jsonl": {
+      "size": 48447,
+      "sha256": "f0e3b781755df2461e7d835ecca1ce26f57b6a182866e2697abd95a24e9433ba"
+    },
+    "charter_real_4x-baseline/eval_holdout_agreement.jsonl": {
+      "size": 92866,
+      "sha256": "e2b3a14af76efec9aae2f81cd32980690772c6f3b510ae0c5fda5fb4b28ed20f"
+    },
+    "charter_real_4x-baseline/eval_holdout_conflict.jsonl": {
+      "size": 92079,
+      "sha256": "d67fb6e0d421e3f9d9e5dd3a9c22346a264d9246df9523a92f67c4bd4a17e131"
+    },
+    "charter_real_4x-baseline/eval_trained_adjacent.jsonl": {
+      "size": 121157,
+      "sha256": "ac79afd0cf5b74f024283f4fbdebfa7a04445d16a81ed71a0ea74808a790b32a"
+    },
+    "charter_real_4x-baseline/eval_trained_agreement.jsonl": {
+      "size": 232224,
+      "sha256": "14d7d001d38b6e7710eb2c16dfb6dcafbc6344c354d7e74b71da12254d7f8d9c"
+    },
+    "charter_real_4x-baseline/eval_trained_conflict.jsonl": {
+      "size": 230213,
+      "sha256": "5f40ef0f95be19aaa883b34afc2550820ac041eaa0ea6a05c8f41b9198570c37"
+    },
+    "charter_real_4x-baseline/sanity.jsonl": {
+      "size": 6336,
+      "sha256": "edf2c53c77fcf343ca4b7592d1f568782e62f3cf2b10ba20137d37c59d9256ca"
+    },
+    "charter_real_4x-baseline/sanity_prompts.jsonl": {
+      "size": 145693,
+      "sha256": "3e435c9e8eb6a35447eca9663dd7b447184e51918578288c290c83e3383da2c4"
+    },
+    "charter_real_4x__coin2-step128/ENDPOINT_DONE.json": {
+      "size": 87,
+      "sha256": "2760921ad25f57da9e9425658566dde5c00a65ad83bccb8ef6871e74c03bb926"
+    },
+    "charter_real_4x__coin2-step128/eval_holdout_adjacent.jsonl": {
+      "size": 48460,
+      "sha256": "d22aece25e6d7e63cdcca355ea0c829c7096b0865d987878e3d095cd4b3499b2"
+    },
+    "charter_real_4x__coin2-step128/eval_holdout_agreement.jsonl": {
+      "size": 92901,
+      "sha256": "dab1eb764c9b4d28bc457efbcb452414f06c6ffb305a892b14a19db625d5d794"
+    },
+    "charter_real_4x__coin2-step128/eval_holdout_conflict.jsonl": {
+      "size": 92112,
+      "sha256": "896d0743b981abac1b8f53dbf624297c8cf3a5b2b6e34c0dfe93854aa0415400"
+    },
+    "charter_real_4x__coin2-step128/eval_trained_adjacent.jsonl": {
+      "size": 121155,
+      "sha256": "bf57f3156ea1ffd23d827e973d071180898baf7f57970f2881da77c1c2459303"
+    },
+    "charter_real_4x__coin2-step128/eval_trained_agreement.jsonl": {
+      "size": 232286,
+      "sha256": "d06bf862e4da2a920599815a8c10546524918c507cac5a9da668f9fe7d001ab6"
+    },
+    "charter_real_4x__coin2-step128/eval_trained_conflict.jsonl": {
+      "size": 230232,
+      "sha256": "aebe84c7a4da91e9137d800b02d39da5e0632a1ba0bd7e0d6d1ecc501dbea83e"
+    },
+    "charter_real_4x__coin2-step128/sanity.jsonl": {
+      "size": 6336,
+      "sha256": "7941b80dcf6c39ea3b980efbb83b12f17048b61d9e384d59f85205d57ddc8370"
+    },
+    "charter_real_4x__coin2-step128/sanity_prompts.jsonl": {
+      "size": 145693,
+      "sha256": "3e435c9e8eb6a35447eca9663dd7b447184e51918578288c290c83e3383da2c4"
+    },
+    "charter_real_4x__coin2-step256/ENDPOINT_DONE.json": {
+      "size": 87,
+      "sha256": "e0a8013566070d100c125d682d50791d866be26f9f03689266e67502ecf93f7f"
+    },
+    "charter_real_4x__coin2-step256/eval_holdout_adjacent.jsonl": {
+      "size": 48463,
+      "sha256": "0172385c0c4ffa51e06f9e3d80632ac284bed81ecc48f37d3f1f1ea216d56101"
+    },
+    "charter_real_4x__coin2-step256/eval_holdout_agreement.jsonl": {
+      "size": 92906,
+      "sha256": "7ed432b280ed0109aad365b01cd802ad7fd8f0afa4a2ed280c045db232dcfdd7"
+    },
+    "charter_real_4x__coin2-step256/eval_holdout_conflict.jsonl": {
+      "size": 92082,
+      "sha256": "f55b7f3b11ef006cafa61ae9b19f9d28918fe251f2db0a7f4536a5c3f66c4245"
+    },
+    "charter_real_4x__coin2-step256/eval_trained_adjacent.jsonl": {
+      "size": 121149,
+      "sha256": "6e5126e1ce29154f22d484dedb5ce87b7980829144a5c4562fb7ea9e7cf23477"
+    },
+    "charter_real_4x__coin2-step256/eval_trained_agreement.jsonl": {
+      "size": 232289,
+      "sha256": "75a068241856e4e87d4e254b653c75f32397a5eee906aca0b3081fb6b09b821d"
+    },
+    "charter_real_4x__coin2-step256/eval_trained_conflict.jsonl": {
+      "size": 230194,
+      "sha256": "987d8807678d7cc2fd59a0ef0a85b049d983c0dcc19115e91812bfc9c44a5654"
+    },
+    "charter_real_4x__coin2-step256/sanity.jsonl": {
+      "size": 6336,
+      "sha256": "7941b80dcf6c39ea3b980efbb83b12f17048b61d9e384d59f85205d57ddc8370"
+    },
+    "charter_real_4x__coin2-step256/sanity_prompts.jsonl": {
+      "size": 145693,
+      "sha256": "3e435c9e8eb6a35447eca9663dd7b447184e51918578288c290c83e3383da2c4"
+    },
+    "charter_real_4x__coin2-step32/ENDPOINT_DONE.json": {
+      "size": 86,
+      "sha256": "18571114236377932ce289672f4b2cbc4cb55c7f8a0634108f9c709003db75d6"
+    },
+    "charter_real_4x__coin2-step32/eval_holdout_adjacent.jsonl": {
+      "size": 48455,
+      "sha256": "f02dcf3dc88e3ece9e79e95ec41a87557559c7283f118780a8da3bc2bd1f4f7d"
+    },
+    "charter_real_4x__coin2-step32/eval_holdout_agreement.jsonl": {
+      "size": 92894,
+      "sha256": "a47b47eaf71124e57d2567ac0c104ef07070df9feec9c0b225704f992f59f340"
+    },
+    "charter_real_4x__coin2-step32/eval_holdout_conflict.jsonl": {
+      "size": 92098,
+      "sha256": "8db8c6d1ff1d197e1ff9485db34de17a2c1abd969ccad4ac727c6b2ae58ea024"
+    },
+    "charter_real_4x__coin2-step32/eval_trained_adjacent.jsonl": {
+      "size": 121146,
+      "sha256": "85767a35453a8ac38c570cfaf6ec7f5fd5dedad6be14b23a7a0fe7eb9e967c22"
+    },
+    "charter_real_4x__coin2-step32/eval_trained_agreement.jsonl": {
+      "size": 232289,
+      "sha256": "ebb4c26955a58b922666f2ec335ae158241d5ca67eeb07aa9db6e4ce364b2039"
+    },
+    "charter_real_4x__coin2-step32/eval_trained_conflict.jsonl": {
+      "size": 230178,
+      "sha256": "dd9806e0d716597bc052b13a71727449c2238303ee3b2b0b6aacf9eb8b8865c2"
+    },
+    "charter_real_4x__coin2-step32/sanity.jsonl": {
+      "size": 6337,
+      "sha256": "8c78c19a196e8166f4a43986aa8278d7ef31e5554f599fda95211cb8c6ed5826"
+    },
+    "charter_real_4x__coin2-step32/sanity_prompts.jsonl": {
+      "size": 145693,
+      "sha256": "3e435c9e8eb6a35447eca9663dd7b447184e51918578288c290c83e3383da2c4"
+    },
+    "charter_real_4x__coin2-step512/ENDPOINT_DONE.json": {
+      "size": 87,
+      "sha256": "4661952b3c9f3a93f7be17a2e3ee1eecf211b0928aff8d2f179276ea36e86678"
+    },
+    "charter_real_4x__coin2-step512/eval_holdout_adjacent.jsonl": {
+      "size": 48470,
+      "sha256": "b28fbe68397ac98e679a660a2234ffbc7dfb5990a2a48e840f109b87982cb287"
+    },
+    "charter_real_4x__coin2-step512/eval_holdout_agreement.jsonl": {
+      "size": 92910,
+      "sha256": "8c2b46f4c04fc690b1363de405dd1534d573c0948868fdda85df0f702d5e3332"
+    },
+    "charter_real_4x__coin2-step512/eval_holdout_conflict.jsonl": {
+      "size": 92095,
+      "sha256": "98a1a9f944e26861ad1598853ab53b01a6c979503a95ad00ebf57e649e8f354b"
+    },
+    "charter_real_4x__coin2-step512/eval_trained_adjacent.jsonl": {
+      "size": 121163,
+      "sha256": "d4b68a46a870ab421e4020cb70e20fd63a6b5bba5b7f5e24f0bd17d2398e8331"
+    },
+    "charter_real_4x__coin2-step512/eval_trained_agreement.jsonl": {
+      "size": 232285,
+      "sha256": "c3f4fee8ca7aac3727bf1b18ebf20b1fe455cb60620f87b5983474ba43295d21"
+    },
+    "charter_real_4x__coin2-step512/eval_trained_conflict.jsonl": {
+      "size": 230189,
+      "sha256": "9fd13b2cdd174a2818aa91c0c257b82a095c1ae3d812d83e584daa1903f2bc72"
+    },
+    "charter_real_4x__coin2-step512/sanity.jsonl": {
+      "size": 6336,
+      "sha256": "25fc0d97697c99838bd6fef4a3487835825484ee3ea6f5fb6d1fe5c78c2e8abc"
+    },
+    "charter_real_4x__coin2-step512/sanity_prompts.jsonl": {
+      "size": 145693,
+      "sha256": "3e435c9e8eb6a35447eca9663dd7b447184e51918578288c290c83e3383da2c4"
+    },
+    "charter_real_4x__coin2-step64/ENDPOINT_DONE.json": {
+      "size": 86,
+      "sha256": "a61558315757792a13a6cb56a1394e3c9a90abef0c1aab20f8c1c823553f83d4"
+    },
+    "charter_real_4x__coin2-step64/eval_holdout_adjacent.jsonl": {
+      "size": 48455,
+      "sha256": "499ee2238191adb3b76b69c0c1cd18f56cd49926a833eaa2789ed60b22f117c5"
+    },
+    "charter_real_4x__coin2-step64/eval_holdout_agreement.jsonl": {
+      "size": 92908,
+      "sha256": "d78e06d4b31a52aee3320617296195ebe684c12c6e530731d848cf768a96b585"
+    },
+    "charter_real_4x__coin2-step64/eval_holdout_conflict.jsonl": {
+      "size": 92097,
+      "sha256": "ed97af30366e406063364f3f3c32fc262e4d1db9617f572db25c8f131b1ed01b"
+    },
+    "charter_real_4x__coin2-step64/eval_trained_adjacent.jsonl": {
+      "size": 121155,
+      "sha256": "5ae2177573652aba57c0fc92ec83be4a7c86eceb54120b3065650d5c523e258a"
+    },
+    "charter_real_4x__coin2-step64/eval_trained_agreement.jsonl": {
+      "size": 232284,
+      "sha256": "a8650548721d3e6543cefb4c9444f1811354f30f9cea95d52e3c02fca9ef2285"
+    },
+    "charter_real_4x__coin2-step64/eval_trained_conflict.jsonl": {
+      "size": 230239,
+      "sha256": "a2af7f72220dbaf3a7153d153f90c1143c7457586736ccbce944557557650798"
+    },
+    "charter_real_4x__coin2-step64/sanity.jsonl": {
+      "size": 6336,
+      "sha256": "f2b5579510dadf56cf3aa84c7bef96103f51b65207752d07e0483ccaa0a85774"
+    },
+    "charter_real_4x__coin2-step64/sanity_prompts.jsonl": {
+      "size": 145693,
+      "sha256": "3e435c9e8eb6a35447eca9663dd7b447184e51918578288c290c83e3383da2c4"
+    },
+    "sanity_prompts.jsonl": {
+      "size": 145693,
+      "sha256": "3e435c9e8eb6a35447eca9663dd7b447184e51918578288c290c83e3383da2c4"
+    }
+  }
+}