Instructions to use arcadia-impact/scimt-dispatch-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use arcadia-impact/scimt-dispatch-models with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="arcadia-impact/scimt-dispatch-models")

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("arcadia-impact/scimt-dispatch-models", device_map="auto")

PEFT
How to use arcadia-impact/scimt-dispatch-models with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use arcadia-impact/scimt-dispatch-models with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "arcadia-impact/scimt-dispatch-models"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/arcadia-impact/scimt-dispatch-models

SGLang

How to use arcadia-impact/scimt-dispatch-models with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "arcadia-impact/scimt-dispatch-models" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "arcadia-impact/scimt-dispatch-models" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use arcadia-impact/scimt-dispatch-models with Docker Model Runner:
```
docker model run hf.co/arcadia-impact/scimt-dispatch-models
```

sidbaines commited on 5 days ago

Commit

0fd909b

verified ·

1 Parent(s): 2ff8d04

verify aft_elicitation_v1/control_matched__text_coin2/results

Browse files

Files changed (1) hide show

aft_elicitation_v1/control_matched__text_coin2/results/ARTIFACT_MANIFEST.json +71 -0

aft_elicitation_v1/control_matched__text_coin2/results/ARTIFACT_MANIFEST.json ADDED Viewed

	@@ -0,0 +1,71 @@

+{
+  "repo": "arcadia-impact/scimt-dispatch-models",
+  "remote_prefix": "aft_elicitation_v1/control_matched__text_coin2/results",
+  "local_folder": "/workspace/elicit/gpu2/results/control_matched__text_coin2-step512",
+  "files": {
+    "eval_holdout_adjacent.jsonl": {
+      "size": 48468,
+      "sha256": "4effc7ba70e528bd0b64f9d067636fa4b618ef6ef47edc1e47053dc248458cf4"
+    },
+    "eval_holdout_agreement.jsonl": {
+      "size": 92910,
+      "sha256": "c9b68d1be3eb441947b16620f3a8f6c1d963fa8fd051c46cf9bcad196dccab34"
+    },
+    "eval_holdout_conflict.jsonl": {
+      "size": 92097,
+      "sha256": "79d11ac6143d9fdf65a085457c0c3b2310c9246cc1d776aed104d67a64c6ccd9"
+    },
+    "eval_trained_adjacent.jsonl": {
+      "size": 121150,
+      "sha256": "91838c4085605509d2ae5f906f33a67b40cd5eab5aa68d03e07c6ce6a84ef5ad"
+    },
+    "eval_trained_agreement.jsonl": {
+      "size": 232284,
+      "sha256": "21524fc8e04d2a1b45c368104f4c7a2fe3c42a2a09da4efc1ed2107e72f1895f"
+    },
+    "eval_trained_conflict.jsonl": {
+      "size": 230161,
+      "sha256": "867c9a48255570a50d6762dd765e52afa0826cc6d65eb0348cafe69d3d72cf9a"
+    },
+    "instr_charter_name__trained_agreement.jsonl": {
+      "size": 232284,
+      "sha256": "b80daa6fbfc66e563906910c4a16641f9ca456eee8476aa61919a309a820b5a0"
+    },
+    "instr_charter_name__trained_conflict.jsonl": {
+      "size": 230165,
+      "sha256": "cae8848fc0cd43c79bca7c67e42dd026ed8cfd13be124364f7db9fe271e1a146"
+    },
+    "instr_charter_text__trained_agreement.jsonl": {
+      "size": 232283,
+      "sha256": "a63ac9b018a69e7b572fdebe00727dbcc20850d777c56a0fec02f7e4cc5527ec"
+    },
+    "instr_charter_text__trained_conflict.jsonl": {
+      "size": 230163,
+      "sha256": "dda81e555d511df432cc144191b261e045c02e36bdba3a45ae7df50e5e525dc4"
+    },
+    "instr_profit__trained_agreement.jsonl": {
+      "size": 232284,
+      "sha256": "cae450a92ec405ee0a88db64c1aac083e3140c607c64f858da21598a2037dfe9"
+    },
+    "instr_profit__trained_conflict.jsonl": {
+      "size": 230163,
+      "sha256": "bfd7f3e5bfa130e3f3855ac27989f429b3236dd1487029d1132bccca8376965f"
+    },
+    "recall_forced_choice.jsonl": {
+      "size": 8196,
+      "sha256": "0029d09911803112d587b9c0b82cac4f12c26d765623a791d11dea404a6d578f"
+    },
+    "recall_freeform.jsonl": {
+      "size": 4664,
+      "sha256": "158414c7e7f12aa5ae752220023f0f61fde8a3a6afb1bec0d86476f43d36be79"
+    },
+    "sanity.jsonl": {
+      "size": 6336,
+      "sha256": "25fc0d97697c99838bd6fef4a3487835825484ee3ea6f5fb6d1fe5c78c2e8abc"
+    },
+    "sanity_prompts.jsonl": {
+      "size": 200015,
+      "sha256": "118d081130041b8b0e596cfa95295286a274ee60e21f4ca9b5ce98d179b8296b"
+    }
+  }
+}