Instructions to use arcadia-impact/scimt-dispatch-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use arcadia-impact/scimt-dispatch-models with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="arcadia-impact/scimt-dispatch-models")

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("arcadia-impact/scimt-dispatch-models", device_map="auto")

PEFT
How to use arcadia-impact/scimt-dispatch-models with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use arcadia-impact/scimt-dispatch-models with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "arcadia-impact/scimt-dispatch-models"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/arcadia-impact/scimt-dispatch-models

SGLang

How to use arcadia-impact/scimt-dispatch-models with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "arcadia-impact/scimt-dispatch-models" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "arcadia-impact/scimt-dispatch-models" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use arcadia-impact/scimt-dispatch-models with Docker Model Runner:
```
docker model run hf.co/arcadia-impact/scimt-dispatch-models
```

sidbaines commited on 5 days ago

Commit

c09e084

verified ·

1 Parent(s): c2abbef

verify aft_elicitation_v1/control_matched__text_agreement/results

Browse files

Files changed (1) hide show

aft_elicitation_v1/control_matched__text_agreement/results/ARTIFACT_MANIFEST.json +71 -0

aft_elicitation_v1/control_matched__text_agreement/results/ARTIFACT_MANIFEST.json ADDED Viewed

	@@ -0,0 +1,71 @@

+{
+  "repo": "arcadia-impact/scimt-dispatch-models",
+  "remote_prefix": "aft_elicitation_v1/control_matched__text_agreement/results",
+  "local_folder": "/workspace/elicit/gpu1/results/control_matched__text_agreement-step512",
+  "files": {
+    "eval_holdout_adjacent.jsonl": {
+      "size": 48461,
+      "sha256": "4a31a3b7c7b01af381a11bdb6ba91526c8a9ace28561431babd2553e9f16e5a2"
+    },
+    "eval_holdout_agreement.jsonl": {
+      "size": 92906,
+      "sha256": "c08b28dbc81d9f4766811d03a875eb70776cebb174db27a09c526a82dae4076b"
+    },
+    "eval_holdout_conflict.jsonl": {
+      "size": 92108,
+      "sha256": "b5390b44b2abcaa8baefde4abfbad2415ae0171bfaa1c3a595d35d1f05b3a6df"
+    },
+    "eval_trained_adjacent.jsonl": {
+      "size": 121174,
+      "sha256": "c0d108a11aa395fb1214204029bf34862c5533de1205fcf99db9b13d0c40f860"
+    },
+    "eval_trained_agreement.jsonl": {
+      "size": 232288,
+      "sha256": "e5a3b4bf53d87e03652763b54c3277ff32d2bccd51d4c447eb429957b701bc16"
+    },
+    "eval_trained_conflict.jsonl": {
+      "size": 230220,
+      "sha256": "84a9f927768b61f86802ecbf4a0bc38a705501c053e7210e144e0fa887442a1f"
+    },
+    "instr_charter_name__trained_agreement.jsonl": {
+      "size": 232289,
+      "sha256": "90ae4a148a6ad33fc810d70d19cdef344308409c7c137f6e4f8f60692137603f"
+    },
+    "instr_charter_name__trained_conflict.jsonl": {
+      "size": 230225,
+      "sha256": "ffa99c3c76b271e31ad2bcc194b5f25ebd5744fd3f7bf2d78a1f8b3fe14fd622"
+    },
+    "instr_charter_text__trained_agreement.jsonl": {
+      "size": 232281,
+      "sha256": "6dac7003ec72adfd39c0601ae02674b901c1c0d0e1951fed70ff677736cf5623"
+    },
+    "instr_charter_text__trained_conflict.jsonl": {
+      "size": 230211,
+      "sha256": "bafc701d2b22699bb61a815f3d65719956cfd4e240c41741434703accb389bf8"
+    },
+    "instr_profit__trained_agreement.jsonl": {
+      "size": 232288,
+      "sha256": "98ed5bca1b87355a58dbfcabd2293e1601b9c20117398d7ce06c8e5da7a57e06"
+    },
+    "instr_profit__trained_conflict.jsonl": {
+      "size": 230208,
+      "sha256": "e318f958f36419a6f6f983e0337dade9126bcd7597e66c12ab80bb6508c2b027"
+    },
+    "recall_forced_choice.jsonl": {
+      "size": 8196,
+      "sha256": "fb9a28a76063489595795a196f02d732f60920c5678f4a37658b04c26b74ea0f"
+    },
+    "recall_freeform.jsonl": {
+      "size": 5380,
+      "sha256": "9e2109cbc817b086b33ed65faa2ec8ff587c525ee80095c6d72576e83e307975"
+    },
+    "sanity.jsonl": {
+      "size": 6451,
+      "sha256": "8c42a7fa7d11c3aed80009dbe7b2460f125eb2ef9a4a325fa8783d93e3294e46"
+    },
+    "sanity_prompts.jsonl": {
+      "size": 209262,
+      "sha256": "3564afabb7d83b2adb69764111f6118a66b7842760dda3489a7b7974735c94f4"
+    }
+  }
+}