Instructions to use arcadia-impact/scimt-dispatch-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use arcadia-impact/scimt-dispatch-models with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="arcadia-impact/scimt-dispatch-models")

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("arcadia-impact/scimt-dispatch-models", device_map="auto")

PEFT
How to use arcadia-impact/scimt-dispatch-models with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use arcadia-impact/scimt-dispatch-models with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "arcadia-impact/scimt-dispatch-models"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/arcadia-impact/scimt-dispatch-models

SGLang

How to use arcadia-impact/scimt-dispatch-models with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "arcadia-impact/scimt-dispatch-models" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "arcadia-impact/scimt-dispatch-models" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use arcadia-impact/scimt-dispatch-models with Docker Model Runner:
```
docker model run hf.co/arcadia-impact/scimt-dispatch-models
```

sidbaines commited on 5 days ago

Commit

81d8b95

verified ·

1 Parent(s): 3e1ca98

verify aft_elicitation_v1/control_matched__baseline/results

Browse files

Files changed (1) hide show

aft_elicitation_v1/control_matched__baseline/results/ARTIFACT_MANIFEST.json +71 -0

aft_elicitation_v1/control_matched__baseline/results/ARTIFACT_MANIFEST.json ADDED Viewed

	@@ -0,0 +1,71 @@

+{
+  "repo": "arcadia-impact/scimt-dispatch-models",
+  "remote_prefix": "aft_elicitation_v1/control_matched__baseline/results",
+  "local_folder": "/workspace/elicit/gpu0/results/control_matched__baseline-baseline",
+  "files": {
+    "eval_holdout_adjacent.jsonl": {
+      "size": 48445,
+      "sha256": "69ef1af71619c9e85a03441734e7dd10d0f23053f6e416c76261e0382d06577a"
+    },
+    "eval_holdout_agreement.jsonl": {
+      "size": 92885,
+      "sha256": "bdb8b81e0b32191e469d866ccf7b58e0a6e68ad0f210d7144367fc74572cf71e"
+    },
+    "eval_holdout_conflict.jsonl": {
+      "size": 92101,
+      "sha256": "8c35fbe7b4fa72b8387ed539ad2ffb170410ac01127480da8ca121efd4251731"
+    },
+    "eval_trained_adjacent.jsonl": {
+      "size": 121168,
+      "sha256": "a4f55209b4ba132641a7264394556b84ee1253e137232203111f5a0072ea0970"
+    },
+    "eval_trained_agreement.jsonl": {
+      "size": 232257,
+      "sha256": "34637a5645c7f58aa866ca7a419de33c90f93fb98b1ebf2052eaf59cf37cd24e"
+    },
+    "eval_trained_conflict.jsonl": {
+      "size": 230198,
+      "sha256": "bb2922b9b11481b68908397e2406b7d38d3bf9c0e410cd4ba261d39ef31b37c5"
+    },
+    "instr_charter_name__trained_agreement.jsonl": {
+      "size": 232238,
+      "sha256": "e64eceac80fc62aa9fb1804cadaeed2ab8b22b25d94c477940a2937981d82524"
+    },
+    "instr_charter_name__trained_conflict.jsonl": {
+      "size": 230209,
+      "sha256": "62f7f20586bfe42795dad49bf9e48b94674e665ea07c38f79cb2caf860121482"
+    },
+    "instr_charter_text__trained_agreement.jsonl": {
+      "size": 232256,
+      "sha256": "07b41e0051c82fe9bd557d38d5d224ad1eebc59cd12b62665e3e5489d10b9aaf"
+    },
+    "instr_charter_text__trained_conflict.jsonl": {
+      "size": 230215,
+      "sha256": "a1e91a97d2a7b3aa7bd489a771002561814e94e428e03832b4d70a9c4c86f547"
+    },
+    "instr_profit__trained_agreement.jsonl": {
+      "size": 232273,
+      "sha256": "472a1d8c8d73b1739d66dd9e5d06976c287f0fcdf1e41e479ba29576537480e4"
+    },
+    "instr_profit__trained_conflict.jsonl": {
+      "size": 230189,
+      "sha256": "967b052d8bc2be9e42b7107e0cfc0f02d7c10708469cf472289c8b7da63679ef"
+    },
+    "recall_forced_choice.jsonl": {
+      "size": 8196,
+      "sha256": "d0bf572f5bb889b7c6bc34782ef660d7c4ba3458396f7d4f1362e7b31937c73d"
+    },
+    "recall_freeform.jsonl": {
+      "size": 6441,
+      "sha256": "fd90a32149360fa9ad170cac46b7ed8383eef71ae14c955fc478d93a04b4127b"
+    },
+    "sanity.jsonl": {
+      "size": 6449,
+      "sha256": "22460c69db1727e60049de85103cc5c7826485c3911d9de77323460a1de008a3"
+    },
+    "sanity_prompts.jsonl": {
+      "size": 154858,
+      "sha256": "9b5e3d3a725004127c0681dc9abe20650c2177c1fa19941c8630ffa6fa99c82d"
+    }
+  }
+}