Instructions to use arcadia-impact/scimt-dispatch-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use arcadia-impact/scimt-dispatch-models with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="arcadia-impact/scimt-dispatch-models")

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("arcadia-impact/scimt-dispatch-models", device_map="auto")

PEFT
How to use arcadia-impact/scimt-dispatch-models with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use arcadia-impact/scimt-dispatch-models with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "arcadia-impact/scimt-dispatch-models"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/arcadia-impact/scimt-dispatch-models

SGLang

How to use arcadia-impact/scimt-dispatch-models with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "arcadia-impact/scimt-dispatch-models" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "arcadia-impact/scimt-dispatch-models" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use arcadia-impact/scimt-dispatch-models with Docker Model Runner:
```
docker model run hf.co/arcadia-impact/scimt-dispatch-models
```

sidbaines commited on 5 days ago

Commit

6ef43c1

verified ·

1 Parent(s): 83a8306

verify aft_elicitation_v1/control_matched__unframed_coin0p5/results

Browse files

Files changed (1) hide show

aft_elicitation_v1/control_matched__unframed_coin0p5/results/ARTIFACT_MANIFEST.json +71 -0

aft_elicitation_v1/control_matched__unframed_coin0p5/results/ARTIFACT_MANIFEST.json ADDED Viewed

	@@ -0,0 +1,71 @@

+{
+  "repo": "arcadia-impact/scimt-dispatch-models",
+  "remote_prefix": "aft_elicitation_v1/control_matched__unframed_coin0p5/results",
+  "local_folder": "/workspace/elicit/gpu3/results/control_matched__unframed_coin0p5-step512",
+  "files": {
+    "eval_holdout_adjacent.jsonl": {
+      "size": 48471,
+      "sha256": "ab802d1408d4ff62be476c14b3610c5705fe5f8675517739e1978bb572270b0d"
+    },
+    "eval_holdout_agreement.jsonl": {
+      "size": 92909,
+      "sha256": "55dc5b84adc03c95c5350f53fbdaadbb43b16b236c9c5df0a9ca78b5a46caf52"
+    },
+    "eval_holdout_conflict.jsonl": {
+      "size": 92096,
+      "sha256": "6464d958b96ce9e1fca425a088c983cd88bd5948a0e97ebd7ca63d54fda5372c"
+    },
+    "eval_trained_adjacent.jsonl": {
+      "size": 121150,
+      "sha256": "280418aac2fa3293081981d7be4d653b7f4dfa9c555bf21cf49c8eb695187a3e"
+    },
+    "eval_trained_agreement.jsonl": {
+      "size": 232284,
+      "sha256": "40b035949cc70624a5b5c798fad818d91c1d7f3780364fb861cd3ec941dc9706"
+    },
+    "eval_trained_conflict.jsonl": {
+      "size": 230200,
+      "sha256": "b0b0e8147f9e782b28523cc8f649c4d46e0143f106efaa0fef75321a1c2a8b37"
+    },
+    "instr_charter_name__trained_agreement.jsonl": {
+      "size": 232284,
+      "sha256": "d5de43ad5187e648668fe3c6c5e569dd10a01e3ac14ef04230736dbb5b18b36a"
+    },
+    "instr_charter_name__trained_conflict.jsonl": {
+      "size": 230201,
+      "sha256": "509d973590fed6d7f0df3c9ac056611a327c08b88ba625f3b9ae95451bd71366"
+    },
+    "instr_charter_text__trained_agreement.jsonl": {
+      "size": 232285,
+      "sha256": "197ab07e7769efbece365d2be6518da6e1dadffe47afff5f7885ec22b1c16ca9"
+    },
+    "instr_charter_text__trained_conflict.jsonl": {
+      "size": 230184,
+      "sha256": "204c4614038a0d601d09397c35887449b2bad1a6ebb27edc5252ae293a4bf991"
+    },
+    "instr_profit__trained_agreement.jsonl": {
+      "size": 232284,
+      "sha256": "286f109025a6a2753965faa922854b09d6c3e47adc05872eb9fcdf4150475a5d"
+    },
+    "instr_profit__trained_conflict.jsonl": {
+      "size": 230188,
+      "sha256": "33e8c277fb36ebfd19b813b8bd593a9a17bb1d020f50d821779ae124192461b4"
+    },
+    "recall_forced_choice.jsonl": {
+      "size": 8196,
+      "sha256": "bdee6d5896ebfce7455a3a6afaf71177b16ffc589c884dcc75059a7e38fae7ac"
+    },
+    "recall_freeform.jsonl": {
+      "size": 4995,
+      "sha256": "10527008bf204aa76d25471d70c5797f07ab7e8ba3fbe81e51bf9f3c72578ff6"
+    },
+    "sanity.jsonl": {
+      "size": 6330,
+      "sha256": "6fb36165e017d94565c311ffe5db33d6d1aecb99b1f9a3260ff196ed62ba1e8d"
+    },
+    "sanity_prompts.jsonl": {
+      "size": 146085,
+      "sha256": "3a86eee4a502185336eca3d1559cc11db53f710dcb1a720af845985bd522aeca"
+    }
+  }
+}