Instructions to use arcadia-impact/scimt-dispatch-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use arcadia-impact/scimt-dispatch-models with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="arcadia-impact/scimt-dispatch-models")

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("arcadia-impact/scimt-dispatch-models", device_map="auto")

PEFT
How to use arcadia-impact/scimt-dispatch-models with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use arcadia-impact/scimt-dispatch-models with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "arcadia-impact/scimt-dispatch-models"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/arcadia-impact/scimt-dispatch-models

SGLang

How to use arcadia-impact/scimt-dispatch-models with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "arcadia-impact/scimt-dispatch-models" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "arcadia-impact/scimt-dispatch-models" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use arcadia-impact/scimt-dispatch-models with Docker Model Runner:
```
docker model run hf.co/arcadia-impact/scimt-dispatch-models
```

sidbaines commited on 5 days ago

Commit

b64f5a8

verified ·

1 Parent(s): 9d25739

verify aft_elicitation_v1/charter_real_4x__unframed_coin0p5/results

Browse files

Files changed (1) hide show

aft_elicitation_v1/charter_real_4x__unframed_coin0p5/results/ARTIFACT_MANIFEST.json +71 -0

aft_elicitation_v1/charter_real_4x__unframed_coin0p5/results/ARTIFACT_MANIFEST.json ADDED Viewed

	@@ -0,0 +1,71 @@

+{
+  "repo": "arcadia-impact/scimt-dispatch-models",
+  "remote_prefix": "aft_elicitation_v1/charter_real_4x__unframed_coin0p5/results",
+  "local_folder": "/workspace/elicit/gpu3/results/charter_real_4x__unframed_coin0p5-step512",
+  "files": {
+    "eval_holdout_adjacent.jsonl": {
+      "size": 48463,
+      "sha256": "0ee585fcc776398fd159a6ae00f3ded42bd06e875d628e7000fbb7b707420775"
+    },
+    "eval_holdout_agreement.jsonl": {
+      "size": 92908,
+      "sha256": "ceff8265e97008b59c66f4c2c779919f85a3a7403f0f84c2e9b6719d295ac7cc"
+    },
+    "eval_holdout_conflict.jsonl": {
+      "size": 92088,
+      "sha256": "511fc2544422b63d422a1b7cc096c4dc3f335a79b65c6dd95f78d0adbd99f83f"
+    },
+    "eval_trained_adjacent.jsonl": {
+      "size": 121157,
+      "sha256": "78dd6fdabc9dd266b41b43fb58b682821677764345c1ff0d09e8dd28f7068998"
+    },
+    "eval_trained_agreement.jsonl": {
+      "size": 232284,
+      "sha256": "a3e60a30e0f6c8907d2e386d96bd93db616ff67b42060cb863a094bd720da6a2"
+    },
+    "eval_trained_conflict.jsonl": {
+      "size": 230199,
+      "sha256": "f02892bfaeede3fad40f54d92d4d895291c9d62031cbb7d2f1b8bf84cc23930b"
+    },
+    "instr_charter_name__trained_agreement.jsonl": {
+      "size": 232284,
+      "sha256": "c52a1e3bf3b29b66214188bb1df2990aa82108248d326e4308b5d165c6f48648"
+    },
+    "instr_charter_name__trained_conflict.jsonl": {
+      "size": 230187,
+      "sha256": "a5c1988e3bb4444c1f503bb0974477e3f6ca7c479b5d93052c32688acca24882"
+    },
+    "instr_charter_text__trained_agreement.jsonl": {
+      "size": 232284,
+      "sha256": "f9a9a096f8d96d61f899b2ea896f392462ca0ee4f31be8e928bc3eff1348f391"
+    },
+    "instr_charter_text__trained_conflict.jsonl": {
+      "size": 230183,
+      "sha256": "3a2e1d5e192a405e783c0d6b31fc899ccf09206a08718a1127b47fd0b5493a69"
+    },
+    "instr_profit__trained_agreement.jsonl": {
+      "size": 232285,
+      "sha256": "2db1801521e206544c59cb9b8f0162b462ccc24f2ae87bd5e4d75d1bdf2bd374"
+    },
+    "instr_profit__trained_conflict.jsonl": {
+      "size": 230186,
+      "sha256": "e474dd1210bb67f55efd73635b670d363d7087f09c3f29a18373fc61642de5d0"
+    },
+    "recall_forced_choice.jsonl": {
+      "size": 8196,
+      "sha256": "d338fe81196dbf1c008279cee0a10b63f87ea1f583a9bee2be3084fcb27d2600"
+    },
+    "recall_freeform.jsonl": {
+      "size": 4262,
+      "sha256": "9ba77b35ba3775b39ca6e81c2e7b8e444e70a189db0f3b89a4f9d7ac5cde8194"
+    },
+    "sanity.jsonl": {
+      "size": 6330,
+      "sha256": "6fb36165e017d94565c311ffe5db33d6d1aecb99b1f9a3260ff196ed62ba1e8d"
+    },
+    "sanity_prompts.jsonl": {
+      "size": 146085,
+      "sha256": "3a86eee4a502185336eca3d1559cc11db53f710dcb1a720af845985bd522aeca"
+    }
+  }
+}