Instructions to use arcadia-impact/scimt-dispatch-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use arcadia-impact/scimt-dispatch-models with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="arcadia-impact/scimt-dispatch-models")

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("arcadia-impact/scimt-dispatch-models", device_map="auto")

PEFT
How to use arcadia-impact/scimt-dispatch-models with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use arcadia-impact/scimt-dispatch-models with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "arcadia-impact/scimt-dispatch-models"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/arcadia-impact/scimt-dispatch-models

SGLang

How to use arcadia-impact/scimt-dispatch-models with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "arcadia-impact/scimt-dispatch-models" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "arcadia-impact/scimt-dispatch-models" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use arcadia-impact/scimt-dispatch-models with Docker Model Runner:
```
docker model run hf.co/arcadia-impact/scimt-dispatch-models
```

sidbaines commited on 5 days ago

Commit

7369868

verified ·

1 Parent(s): 038310b

verify aft_elicitation_v1/charter_real_4x__text_coin2/results

Browse files

Files changed (1) hide show

aft_elicitation_v1/charter_real_4x__text_coin2/results/ARTIFACT_MANIFEST.json +71 -0

aft_elicitation_v1/charter_real_4x__text_coin2/results/ARTIFACT_MANIFEST.json ADDED Viewed

	@@ -0,0 +1,71 @@

+{
+  "repo": "arcadia-impact/scimt-dispatch-models",
+  "remote_prefix": "aft_elicitation_v1/charter_real_4x__text_coin2/results",
+  "local_folder": "/workspace/elicit/gpu2/results/charter_real_4x__text_coin2-step512",
+  "files": {
+    "eval_holdout_adjacent.jsonl": {
+      "size": 48470,
+      "sha256": "9ea42bebb9cd8f2f4f4f9e5db74766238e633c2c77db8a7cdaab12be99b87417"
+    },
+    "eval_holdout_agreement.jsonl": {
+      "size": 92911,
+      "sha256": "c344d626a68031406beb01ad777fcb7186abdf138ffeddee826cffdd1cad532e"
+    },
+    "eval_holdout_conflict.jsonl": {
+      "size": 92096,
+      "sha256": "f07282c71c005aeb3bd5f31e0a33b7cf7d87fd125e18f5c276f90927c25dc156"
+    },
+    "eval_trained_adjacent.jsonl": {
+      "size": 121158,
+      "sha256": "835d9cb2ff3f960a3fe826e1c345ffff75d054ccb0c15e56f82686620e8ab389"
+    },
+    "eval_trained_agreement.jsonl": {
+      "size": 232286,
+      "sha256": "3a054b74852bc17e4e1b1349d3cb6ae53e6ed5739c00b7da78559967d9f1c0fd"
+    },
+    "eval_trained_conflict.jsonl": {
+      "size": 230168,
+      "sha256": "0283cfe8e13ec0e5414f8a34e300f00a5c2eacece4b4867f9865191e5a402442"
+    },
+    "instr_charter_name__trained_agreement.jsonl": {
+      "size": 232285,
+      "sha256": "9eb29c30583cc70dc261057884756f7fbead921cc65f98ce2816ebd024970255"
+    },
+    "instr_charter_name__trained_conflict.jsonl": {
+      "size": 230165,
+      "sha256": "c9b1bfa2a01fb64bbc1190da4b540c2ec32f282c6454853f9cbadd503e6bc868"
+    },
+    "instr_charter_text__trained_agreement.jsonl": {
+      "size": 232284,
+      "sha256": "5f9be4aa550ad22b87f92e5b52cdae71a07660e90c3836f946825f67b65e2f72"
+    },
+    "instr_charter_text__trained_conflict.jsonl": {
+      "size": 230163,
+      "sha256": "62feb66d38c55ec90a970a10831cfd3030dc623faf1fbd3a989d7d06b85a7c73"
+    },
+    "instr_profit__trained_agreement.jsonl": {
+      "size": 232283,
+      "sha256": "9ff5293d3afb081c8a47e8de3ac79367f93734f1493f6a5fd51d4797857b6b2d"
+    },
+    "instr_profit__trained_conflict.jsonl": {
+      "size": 230164,
+      "sha256": "271499d24b4311b6f10cb48a9447abc46ddae6f99856c7bd719c73ca16741389"
+    },
+    "recall_forced_choice.jsonl": {
+      "size": 8196,
+      "sha256": "b6c4a39ac607f48442220811595e9b0f6beae56c406ae29c3c2d3c64a3785518"
+    },
+    "recall_freeform.jsonl": {
+      "size": 3781,
+      "sha256": "7295a4b88099365075e6622a60358475a6078d35715431c22ef0ca28766b9a42"
+    },
+    "sanity.jsonl": {
+      "size": 6336,
+      "sha256": "25fc0d97697c99838bd6fef4a3487835825484ee3ea6f5fb6d1fe5c78c2e8abc"
+    },
+    "sanity_prompts.jsonl": {
+      "size": 200015,
+      "sha256": "118d081130041b8b0e596cfa95295286a274ee60e21f4ca9b5ce98d179b8296b"
+    }
+  }
+}