Instructions to use arcadia-impact/scimt-dispatch-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use arcadia-impact/scimt-dispatch-models with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="arcadia-impact/scimt-dispatch-models")

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("arcadia-impact/scimt-dispatch-models", device_map="auto")

PEFT
How to use arcadia-impact/scimt-dispatch-models with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use arcadia-impact/scimt-dispatch-models with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "arcadia-impact/scimt-dispatch-models"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/arcadia-impact/scimt-dispatch-models

SGLang

How to use arcadia-impact/scimt-dispatch-models with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "arcadia-impact/scimt-dispatch-models" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "arcadia-impact/scimt-dispatch-models" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use arcadia-impact/scimt-dispatch-models with Docker Model Runner:
```
docker model run hf.co/arcadia-impact/scimt-dispatch-models
```

sidbaines commited on 12 days ago

Commit

ef83399

verified ·

1 Parent(s): 472238f

verify aft_wave_v2/coin_real_4x__agreement/results

Browse files

Files changed (1) hide show

aft_wave_v2/coin_real_4x__agreement/results/ARTIFACT_MANIFEST.json +231 -0

aft_wave_v2/coin_real_4x__agreement/results/ARTIFACT_MANIFEST.json ADDED Viewed

	@@ -0,0 +1,231 @@

+{
+  "repo": "arcadia-impact/scimt-dispatch-models",
+  "remote_prefix": "aft_wave_v2/coin_real_4x__agreement/results",
+  "local_folder": "/workspace/wave/results",
+  "files": {
+    "charter_fake_4x-baseline/sanity_prompts.jsonl": {
+      "size": 154858,
+      "sha256": "9b5e3d3a725004127c0681dc9abe20650c2177c1fa19941c8630ffa6fa99c82d"
+    },
+    "coin_real_4x-baseline/ENDPOINT_DONE.json": {
+      "size": 51,
+      "sha256": "3c5091b417e9afe5bd7b68525c7be09ea66ff38584a9e348e91ff9e2a1df6301"
+    },
+    "coin_real_4x-baseline/eval_holdout_adjacent.jsonl": {
+      "size": 48430,
+      "sha256": "58758ba76040f69068c165781b87fe8febb3b533f17d43009fa6c3392d1efe86"
+    },
+    "coin_real_4x-baseline/eval_holdout_agreement.jsonl": {
+      "size": 92891,
+      "sha256": "fc79bb5c6d1f3f99fedd45a08ae9cd679e5222ea2e0e182e2234e648b3727056"
+    },
+    "coin_real_4x-baseline/eval_holdout_conflict.jsonl": {
+      "size": 92106,
+      "sha256": "66c32f1a58b5250d266a521c3b665e7039afe0c2411d6835b4bb7e4b3c294bd7"
+    },
+    "coin_real_4x-baseline/eval_trained_adjacent.jsonl": {
+      "size": 121151,
+      "sha256": "1bd45544fd2cf2b7395b733b74cc9fe6a37ff6f8ca5350da7031a6a5f88cd1b2"
+    },
+    "coin_real_4x-baseline/eval_trained_agreement.jsonl": {
+      "size": 232248,
+      "sha256": "d497e9dc7bb599613bbbe79cd7e1e237db6a3cd7ca2c3bfae44dd6e5efe33ccd"
+    },
+    "coin_real_4x-baseline/eval_trained_conflict.jsonl": {
+      "size": 230143,
+      "sha256": "baf5d3d6762a1ab00ae33103206d1be2edd72bc4939b0a7b09649c34fae693eb"
+    },
+    "coin_real_4x-baseline/sanity.jsonl": {
+      "size": 6450,
+      "sha256": "d6fdb19ac4271f22a5703afa0a7d7cc474ea74427158097bbefadeeb85490510"
+    },
+    "coin_real_4x-baseline/sanity_prompts.jsonl": {
+      "size": 154858,
+      "sha256": "9b5e3d3a725004127c0681dc9abe20650c2177c1fa19941c8630ffa6fa99c82d"
+    },
+    "coin_real_4x__agreement-step128/ENDPOINT_DONE.json": {
+      "size": 88,
+      "sha256": "2c8417d003458d9fd801e58e2675bcc4be8e3e6c7b382be05ef9216841732743"
+    },
+    "coin_real_4x__agreement-step128/eval_holdout_adjacent.jsonl": {
+      "size": 48460,
+      "sha256": "441d5990cc14cd3e8bb903131075938d1451792baa8d39f3bbb1abb9414408d9"
+    },
+    "coin_real_4x__agreement-step128/eval_holdout_agreement.jsonl": {
+      "size": 92920,
+      "sha256": "fa0bf4289a2100127c3c095c1a659dc6a428fdaac09770bb8d5fea5274aac9dd"
+    },
+    "coin_real_4x__agreement-step128/eval_holdout_conflict.jsonl": {
+      "size": 92091,
+      "sha256": "8ec2bc93ad8ce1c89855cc4c1782c5261a6c7122b3de4217441a56107a6e2781"
+    },
+    "coin_real_4x__agreement-step128/eval_trained_adjacent.jsonl": {
+      "size": 121170,
+      "sha256": "edfb51b293ea84f5f7e84dd05c2dd45d165db4c63c0010061bf5e57156ec7cab"
+    },
+    "coin_real_4x__agreement-step128/eval_trained_agreement.jsonl": {
+      "size": 232293,
+      "sha256": "c32f19db052fe1b35cce7f9a70234b677d2cf91384abab2184a614105beaf3c9"
+    },
+    "coin_real_4x__agreement-step128/eval_trained_conflict.jsonl": {
+      "size": 230169,
+      "sha256": "82ff7d2b189c66892ca28febc1f453f506efe4799a8e43b8e80c4c13318d3186"
+    },
+    "coin_real_4x__agreement-step128/sanity.jsonl": {
+      "size": 6452,
+      "sha256": "088f84612e241926f9712fb0358f5ea162289045b0a135ff5c21689dff9cd142"
+    },
+    "coin_real_4x__agreement-step128/sanity_prompts.jsonl": {
+      "size": 154858,
+      "sha256": "9b5e3d3a725004127c0681dc9abe20650c2177c1fa19941c8630ffa6fa99c82d"
+    },
+    "coin_real_4x__agreement-step256/ENDPOINT_DONE.json": {
+      "size": 88,
+      "sha256": "bad4f7f1c14ade6e5dda301e8549b2196ebc89090d8a71f8c15c07b2d690c41d"
+    },
+    "coin_real_4x__agreement-step256/eval_holdout_adjacent.jsonl": {
+      "size": 48456,
+      "sha256": "1726ba8da32890ae6ff8b232be25505f8b2dfe7b6a863071764217634476e269"
+    },
+    "coin_real_4x__agreement-step256/eval_holdout_agreement.jsonl": {
+      "size": 92905,
+      "sha256": "365680251ded23cb82842be6d75da7e45073b561bddbc45603ede7d3b7c4400a"
+    },
+    "coin_real_4x__agreement-step256/eval_holdout_conflict.jsonl": {
+      "size": 92096,
+      "sha256": "a94c27d062f58c4131978b88829df2a463a68ede10aa69add6cb6059cc16c117"
+    },
+    "coin_real_4x__agreement-step256/eval_trained_adjacent.jsonl": {
+      "size": 121148,
+      "sha256": "841ee2100eb87bc0087c1d48f5e7d50bbfbbab0f5a75319b637be23fc590bb5c"
+    },
+    "coin_real_4x__agreement-step256/eval_trained_agreement.jsonl": {
+      "size": 232286,
+      "sha256": "d77ca24ac70b1538d79d92632e4f6d93c98c1847d2716b771cf3aaa065147971"
+    },
+    "coin_real_4x__agreement-step256/eval_trained_conflict.jsonl": {
+      "size": 230159,
+      "sha256": "37c33e89350bdd05e6ae5cc152c3305bfebad63811a415cb8b04e09f1f3fb6d4"
+    },
+    "coin_real_4x__agreement-step256/sanity.jsonl": {
+      "size": 6451,
+      "sha256": "8c42a7fa7d11c3aed80009dbe7b2460f125eb2ef9a4a325fa8783d93e3294e46"
+    },
+    "coin_real_4x__agreement-step256/sanity_prompts.jsonl": {
+      "size": 154858,
+      "sha256": "9b5e3d3a725004127c0681dc9abe20650c2177c1fa19941c8630ffa6fa99c82d"
+    },
+    "coin_real_4x__agreement-step32/ENDPOINT_DONE.json": {
+      "size": 87,
+      "sha256": "9a18a9e8024a2bfde8df8a2cbc2da690345c050595ea716ede0d06abef78c96d"
+    },
+    "coin_real_4x__agreement-step32/eval_holdout_adjacent.jsonl": {
+      "size": 48457,
+      "sha256": "421ff93d4f391de21f5d9c5420c5403c9f1b0992eaa9d5418c9a2ede3d74f2d8"
+    },
+    "coin_real_4x__agreement-step32/eval_holdout_agreement.jsonl": {
+      "size": 92918,
+      "sha256": "3ce7904c9b39252d551e5275540fc200d5948652ec3daba7b06715b4dbc84636"
+    },
+    "coin_real_4x__agreement-step32/eval_holdout_conflict.jsonl": {
+      "size": 92116,
+      "sha256": "3f6468786fcb41f042b39044c219786c17555c0164c07fad26ab4d1644fde79d"
+    },
+    "coin_real_4x__agreement-step32/eval_trained_adjacent.jsonl": {
+      "size": 121162,
+      "sha256": "46cadbacc5007de5a4ca96bc5d05abfb5cade153b99fbc58c2f04153e31205e3"
+    },
+    "coin_real_4x__agreement-step32/eval_trained_agreement.jsonl": {
+      "size": 232295,
+      "sha256": "340ce352cb9d960cb0ce2cd04e579d04e26225b8c7a66db142b0fda1e1e3379e"
+    },
+    "coin_real_4x__agreement-step32/eval_trained_conflict.jsonl": {
+      "size": 230171,
+      "sha256": "a9f50618bbba36687e824f87f673650830763281dd56cc1fad899bfac8533a0a"
+    },
+    "coin_real_4x__agreement-step32/sanity.jsonl": {
+      "size": 6450,
+      "sha256": "e33e9cfe88d551c73ea396c872b802c1ebdf2b691a8e8cee55ee333476366e33"
+    },
+    "coin_real_4x__agreement-step32/sanity_prompts.jsonl": {
+      "size": 154858,
+      "sha256": "9b5e3d3a725004127c0681dc9abe20650c2177c1fa19941c8630ffa6fa99c82d"
+    },
+    "coin_real_4x__agreement-step512/ENDPOINT_DONE.json": {
+      "size": 88,
+      "sha256": "79ca34ef1e8a7f32853c5c83717190678e856fc067a804a8748a5f5d793d0b01"
+    },
+    "coin_real_4x__agreement-step512/eval_holdout_adjacent.jsonl": {
+      "size": 48464,
+      "sha256": "37ebaf5650920a3e971ff981a9492195e76b8cc71b8e6e429e76e78d5f71e68a"
+    },
+    "coin_real_4x__agreement-step512/eval_holdout_agreement.jsonl": {
+      "size": 92908,
+      "sha256": "25cd3978794cd527a90c5ed47d5a5a5c334f2e62415851d35ae6b2ae8836e825"
+    },
+    "coin_real_4x__agreement-step512/eval_holdout_conflict.jsonl": {
+      "size": 92088,
+      "sha256": "df58775dd1354218723303243506a952c0793875f831f6124f48f6458b968c81"
+    },
+    "coin_real_4x__agreement-step512/eval_trained_adjacent.jsonl": {
+      "size": 121145,
+      "sha256": "832f74c17e7e0298594437ec254d71bde762b74638416ab76138e032658e242f"
+    },
+    "coin_real_4x__agreement-step512/eval_trained_agreement.jsonl": {
+      "size": 232283,
+      "sha256": "19158df9c537c91eedff3f67e7382825dbaee6ee67da2439aeb4751bce60e2a1"
+    },
+    "coin_real_4x__agreement-step512/eval_trained_conflict.jsonl": {
+      "size": 230164,
+      "sha256": "b417899d1914a8355a0ff6b9485eaa83cc33c1d1f7e90493abc87d3fdeaf0cfc"
+    },
+    "coin_real_4x__agreement-step512/sanity.jsonl": {
+      "size": 6451,
+      "sha256": "8c42a7fa7d11c3aed80009dbe7b2460f125eb2ef9a4a325fa8783d93e3294e46"
+    },
+    "coin_real_4x__agreement-step512/sanity_prompts.jsonl": {
+      "size": 154858,
+      "sha256": "9b5e3d3a725004127c0681dc9abe20650c2177c1fa19941c8630ffa6fa99c82d"
+    },
+    "coin_real_4x__agreement-step64/ENDPOINT_DONE.json": {
+      "size": 87,
+      "sha256": "300042d4aeb502da1d1ada88ef04cef93394038be0199a04b870326fe9943dd2"
+    },
+    "coin_real_4x__agreement-step64/eval_holdout_adjacent.jsonl": {
+      "size": 48452,
+      "sha256": "ee4fc83008b148943cca065e499b276195296679615f4f5877b7fc6930d9b409"
+    },
+    "coin_real_4x__agreement-step64/eval_holdout_agreement.jsonl": {
+      "size": 92914,
+      "sha256": "b75f303374f53123d086762f0b528835821d1b102dab51e8e3c1008f3ef62d46"
+    },
+    "coin_real_4x__agreement-step64/eval_holdout_conflict.jsonl": {
+      "size": 92101,
+      "sha256": "683a723925c2d631cfd0ed09325bf8adb86890007c3471d487dad30a68fa8a31"
+    },
+    "coin_real_4x__agreement-step64/eval_trained_adjacent.jsonl": {
+      "size": 121161,
+      "sha256": "58dac0bec04b6f20699439256b87c151a18b598845f94cf456c341dd34860eaa"
+    },
+    "coin_real_4x__agreement-step64/eval_trained_agreement.jsonl": {
+      "size": 232295,
+      "sha256": "3a2255d973d4681e5890049ed2f1947a1bbc5f695b49d087174d3ae63eb6c418"
+    },
+    "coin_real_4x__agreement-step64/eval_trained_conflict.jsonl": {
+      "size": 230181,
+      "sha256": "8aa7c6189921f4294882f22dbd885856bb9c006347af77aa3814d0978031698f"
+    },
+    "coin_real_4x__agreement-step64/sanity.jsonl": {
+      "size": 6450,
+      "sha256": "de16a808c152dea4c98a8ca5889f25dadb58403fc0cc8f278839753a9b06f370"
+    },
+    "coin_real_4x__agreement-step64/sanity_prompts.jsonl": {
+      "size": 154858,
+      "sha256": "9b5e3d3a725004127c0681dc9abe20650c2177c1fa19941c8630ffa6fa99c82d"
+    },
+    "sanity_prompts.jsonl": {
+      "size": 154858,
+      "sha256": "9b5e3d3a725004127c0681dc9abe20650c2177c1fa19941c8630ffa6fa99c82d"
+    }
+  }
+}