Instructions to use arcadia-impact/scimt-dispatch-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use arcadia-impact/scimt-dispatch-models with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="arcadia-impact/scimt-dispatch-models")

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("arcadia-impact/scimt-dispatch-models", device_map="auto")

PEFT
How to use arcadia-impact/scimt-dispatch-models with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use arcadia-impact/scimt-dispatch-models with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "arcadia-impact/scimt-dispatch-models"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/arcadia-impact/scimt-dispatch-models

SGLang

How to use arcadia-impact/scimt-dispatch-models with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "arcadia-impact/scimt-dispatch-models" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "arcadia-impact/scimt-dispatch-models" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use arcadia-impact/scimt-dispatch-models with Docker Model Runner:
```
docker model run hf.co/arcadia-impact/scimt-dispatch-models
```

sidbaines commited on 6 days ago

Commit

9d25739

verified ·

1 Parent(s): a2fa3bd

verify aft_elicitation_v1/charter_real_4x__unframed_agreement/results

Browse files

Files changed (1) hide show

aft_elicitation_v1/charter_real_4x__unframed_agreement/results/ARTIFACT_MANIFEST.json +71 -0

aft_elicitation_v1/charter_real_4x__unframed_agreement/results/ARTIFACT_MANIFEST.json ADDED Viewed

	@@ -0,0 +1,71 @@

+{
+  "repo": "arcadia-impact/scimt-dispatch-models",
+  "remote_prefix": "aft_elicitation_v1/charter_real_4x__unframed_agreement/results",
+  "local_folder": "/workspace/elicit/gpu1/results/charter_real_4x__unframed_agreement-step512",
+  "files": {
+    "eval_holdout_adjacent.jsonl": {
+      "size": 48459,
+      "sha256": "9c3333e9bfad18e74c2cb5b68eebd3f580ae9c0df7facaf6f30318b2cbc06cfa"
+    },
+    "eval_holdout_agreement.jsonl": {
+      "size": 92912,
+      "sha256": "7484f986ac5eb34551c851445800d5fc8c739031646ae2f5459bd7418f1b31c8"
+    },
+    "eval_holdout_conflict.jsonl": {
+      "size": 92094,
+      "sha256": "7f748d6dffaf789f65dd256b4eb8dc2cc372812e04b3e920afcf386e26afc21c"
+    },
+    "eval_trained_adjacent.jsonl": {
+      "size": 121162,
+      "sha256": "549787408668d106e39fde52e0eca1fc50f4d99bba022dca3eba3178aeb7a032"
+    },
+    "eval_trained_agreement.jsonl": {
+      "size": 232283,
+      "sha256": "18e9ac96eca7c2c016a12aab28d91000d5ee38b57e7a81c0ce2ef3d3818157d0"
+    },
+    "eval_trained_conflict.jsonl": {
+      "size": 230244,
+      "sha256": "df5d38f4e1bd31eaf003178e9808ab0b01f6a507fbdb1b16bf900a77087397fd"
+    },
+    "instr_charter_name__trained_agreement.jsonl": {
+      "size": 232284,
+      "sha256": "8733b02d2c4b031f2a37f3bce6679eb6c12f111e955ae97d0b9d5bf1384ffe99"
+    },
+    "instr_charter_name__trained_conflict.jsonl": {
+      "size": 230237,
+      "sha256": "33f6fba82d35ede5567942533179cfc4caa1616a3ba8ac7f4b51aff3cf813972"
+    },
+    "instr_charter_text__trained_agreement.jsonl": {
+      "size": 232284,
+      "sha256": "cfb31f4a1d277e0252c209092fe432dc0d6fec07ed7f5bcc0cb7cadb56852da9"
+    },
+    "instr_charter_text__trained_conflict.jsonl": {
+      "size": 230239,
+      "sha256": "7872bac867b7f63b0a2cd930c240ffb6ebbe123ad8c8d8de552979353f269a10"
+    },
+    "instr_profit__trained_agreement.jsonl": {
+      "size": 232281,
+      "sha256": "f69e7f61541f1b10b92eaa1e1a19871aece9d8ed456d1380eb530ac508620169"
+    },
+    "instr_profit__trained_conflict.jsonl": {
+      "size": 230228,
+      "sha256": "5e1e03e246cb726ce87f97a5ade480c2a41f0f784b088002bc5f0221b2533aeb"
+    },
+    "recall_forced_choice.jsonl": {
+      "size": 8196,
+      "sha256": "ab47f95f617bd76d7d5cef8690461b2b59b6d789c9d582cf23335bbf5bee216a"
+    },
+    "recall_freeform.jsonl": {
+      "size": 3896,
+      "sha256": "077e6b1f6023ab43afcdd89388db1b37378fb1013d3e254ba7a464035b77deee"
+    },
+    "sanity.jsonl": {
+      "size": 6451,
+      "sha256": "8c42a7fa7d11c3aed80009dbe7b2460f125eb2ef9a4a325fa8783d93e3294e46"
+    },
+    "sanity_prompts.jsonl": {
+      "size": 154858,
+      "sha256": "9b5e3d3a725004127c0681dc9abe20650c2177c1fa19941c8630ffa6fa99c82d"
+    }
+  }
+}