Instructions to use arcadia-impact/scimt-dispatch-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use arcadia-impact/scimt-dispatch-models with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="arcadia-impact/scimt-dispatch-models")

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("arcadia-impact/scimt-dispatch-models", device_map="auto")

PEFT
How to use arcadia-impact/scimt-dispatch-models with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use arcadia-impact/scimt-dispatch-models with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "arcadia-impact/scimt-dispatch-models"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/arcadia-impact/scimt-dispatch-models

SGLang

How to use arcadia-impact/scimt-dispatch-models with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "arcadia-impact/scimt-dispatch-models" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "arcadia-impact/scimt-dispatch-models" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "arcadia-impact/scimt-dispatch-models",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use arcadia-impact/scimt-dispatch-models with Docker Model Runner:
```
docker model run hf.co/arcadia-impact/scimt-dispatch-models
```

sidbaines commited on 5 days ago

Commit

2b6104e

verified ·

1 Parent(s): dd3d134

verify aft_elicitation_v1/charter_real_4x__text_agreement/results

Browse files

Files changed (1) hide show

aft_elicitation_v1/charter_real_4x__text_agreement/results/ARTIFACT_MANIFEST.json +71 -0

aft_elicitation_v1/charter_real_4x__text_agreement/results/ARTIFACT_MANIFEST.json ADDED Viewed

	@@ -0,0 +1,71 @@

+{
+  "repo": "arcadia-impact/scimt-dispatch-models",
+  "remote_prefix": "aft_elicitation_v1/charter_real_4x__text_agreement/results",
+  "local_folder": "/workspace/elicit/gpu1/results/charter_real_4x__text_agreement-step512",
+  "files": {
+    "eval_holdout_adjacent.jsonl": {
+      "size": 48459,
+      "sha256": "87a0597a90afd5808ebe1da00da3cca92f635232d2aafdbf6b016f974c79c54d"
+    },
+    "eval_holdout_agreement.jsonl": {
+      "size": 92897,
+      "sha256": "c892706414c9fd50de1337e6b5b1a90458026fe136aff376ff26dfb42ee44756"
+    },
+    "eval_holdout_conflict.jsonl": {
+      "size": 92090,
+      "sha256": "fe7b99b3ba5c5f39c37751f8e015b1335824489a2ab93e39e2a4679a380e3dfe"
+    },
+    "eval_trained_adjacent.jsonl": {
+      "size": 121168,
+      "sha256": "101c427d2d5d98328334a5ebbdfad305e80d12df8c98bf416f6b9ccce8913521"
+    },
+    "eval_trained_agreement.jsonl": {
+      "size": 232286,
+      "sha256": "e8b95f073b315142004189260270c0507104000a9bc07e745fa9e2e2f97ab816"
+    },
+    "eval_trained_conflict.jsonl": {
+      "size": 230233,
+      "sha256": "7638a11f577634c2018a86c67c0ceb4972abd2fa2ff7710beffbdcb29f5fc588"
+    },
+    "instr_charter_name__trained_agreement.jsonl": {
+      "size": 232282,
+      "sha256": "b0056353d06dfaaadf1e97db0fe6d09fc60b15baf95c3727d90d274be1c114a2"
+    },
+    "instr_charter_name__trained_conflict.jsonl": {
+      "size": 230240,
+      "sha256": "8d376ee41c206f85253b3f7f874a0acd66704b31712c4ac348e73a67d501d9cc"
+    },
+    "instr_charter_text__trained_agreement.jsonl": {
+      "size": 232281,
+      "sha256": "cc13b95fcaec08845505d30047bd0e8f50f9c46ae88516c94ac6de2813b5940e"
+    },
+    "instr_charter_text__trained_conflict.jsonl": {
+      "size": 230248,
+      "sha256": "0c26cd13bd3e6081f09dd96e4b1de3095fb2cd6a68b5684acdba4d4f6c5c542e"
+    },
+    "instr_profit__trained_agreement.jsonl": {
+      "size": 232283,
+      "sha256": "0eb1b955a06767f2fdf9d32f707f16ce31afd04c0647e5632ecf5bb2d2f11515"
+    },
+    "instr_profit__trained_conflict.jsonl": {
+      "size": 230226,
+      "sha256": "93e4fcc63bb0e667d48d52092345cad907fd725764a72ea25026bb0415ab9bd9"
+    },
+    "recall_forced_choice.jsonl": {
+      "size": 8196,
+      "sha256": "30f4cf580edf5e175e17b99fbc960ca865b03738afe772f41f54537400b77f89"
+    },
+    "recall_freeform.jsonl": {
+      "size": 4216,
+      "sha256": "c88ec21b84fb1c3c279c61fb1e6a576147d7ebdb0bc16290883e2c9a08ff47ce"
+    },
+    "sanity.jsonl": {
+      "size": 6451,
+      "sha256": "8c42a7fa7d11c3aed80009dbe7b2460f125eb2ef9a4a325fa8783d93e3294e46"
+    },
+    "sanity_prompts.jsonl": {
+      "size": 209262,
+      "sha256": "3564afabb7d83b2adb69764111f6118a66b7842760dda3489a7b7974735c94f4"
+    }
+  }
+}