Instructions to use cosmicoptima/computer-9a with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use cosmicoptima/computer-9a with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="cosmicoptima/computer-9a")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("cosmicoptima/computer-9a")
model = AutoModelForCausalLM.from_pretrained("cosmicoptima/computer-9a", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use cosmicoptima/computer-9a with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "cosmicoptima/computer-9a"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "cosmicoptima/computer-9a",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/cosmicoptima/computer-9a

SGLang

How to use cosmicoptima/computer-9a with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "cosmicoptima/computer-9a" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "cosmicoptima/computer-9a",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "cosmicoptima/computer-9a" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "cosmicoptima/computer-9a",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use cosmicoptima/computer-9a with Docker Model Runner:
```
docker model run hf.co/cosmicoptima/computer-9a
```

cosmicoptima commited on 2 days ago

Commit

3f7fe2e

verified ·

1 Parent(s): 017994e

Add files using upload-large-folder tool

Browse files

Files changed (19) hide show

model-00004-of-00062.safetensors +3 -0
model-00007-of-00062.safetensors +3 -0
model-00010-of-00062.safetensors +3 -0
model-00013-of-00062.safetensors +3 -0
model-00016-of-00062.safetensors +3 -0
model-00019-of-00062.safetensors +3 -0
model-00022-of-00062.safetensors +3 -0
model-00025-of-00062.safetensors +3 -0
model-00028-of-00062.safetensors +3 -0
model-00031-of-00062.safetensors +3 -0
model-00034-of-00062.safetensors +3 -0
model-00037-of-00062.safetensors +3 -0
model-00040-of-00062.safetensors +3 -0
model-00043-of-00062.safetensors +3 -0
model-00046-of-00062.safetensors +3 -0
model-00049-of-00062.safetensors +3 -0
model-00052-of-00062.safetensors +3 -0
model-00055-of-00062.safetensors +3 -0
model-00058-of-00062.safetensors +3 -0

model-00004-of-00062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:eb8ec38fd67081c2ddfa4eee8798574bbffc83ab483337d7e7f76984a023da84
+size 2483095376

model-00007-of-00062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e7a8ae615cca04d756a6e7b136457ecfadd0d5557ace63a4beda3a4e3d56c68d
+size 2483095376

model-00010-of-00062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:586fcfb2e8ae02c8abbc66492959b7a14a29dd464fb0270d4935e2460856a360
+size 2483095392

model-00013-of-00062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c4bbe5a97e6da347471e48cdc5d331005f948e1a497288514736ca212b206917
+size 2483095392

model-00016-of-00062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:532980c63bde2ccf0d89e2613633002117ee6ed4d3dfae7687811377f512629c
+size 2483095392

model-00019-of-00062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fa1e22fa152a3a3bcc9b3ec6ae670db5baffc1800c625386a3dccf1d8abaaedb
+size 2483095392

model-00022-of-00062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4d177cbc64106ef6f3ad9af5971402c7bf14ae237755d9610bf1481ef29cab7d
+size 2483095392

model-00025-of-00062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6636b77d2034854f246ad9d067841c63ed5cd0fcbf77f2cb7b91fe1085ecc86c
+size 2483095392

model-00028-of-00062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8f628137c8f632bd63911bbc5aca4c204c44aea2ad5b1b73764a69496efc3f69
+size 2483095392

model-00031-of-00062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:59f411f9283251a949076b8854154b0e0ca502288174aa1dde3b7f529797ae7a
+size 2483095392

model-00034-of-00062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cfe59a1e364c2fbc4a8296cbe2e152f1db4ebc2f6158527463c2a0bb8c1a8490
+size 2483095392

model-00037-of-00062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:119384027e48da4d5d0eafff749e83758afeeab0ef929dc37ad64479c3142158
+size 2483095392

model-00040-of-00062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a9ca17a12a1edd844d28335f28c27d236c88c6854c2c09d15faeecfa791c4322
+size 2483095392

model-00043-of-00062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1812cd7a27f99ef0d2a3e651a386557091c0301d8000a71ae53d34b8c5b03d47
+size 2483095392

model-00046-of-00062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7f15350654482c0685174b893306c3f2812eceb5b396e2b1441ec8d1a11d9a0f
+size 2483095392

model-00049-of-00062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:09cab7ad2e4e66d2c76e092d40067f3dc43eab4c0f8e90c0a789e446c6a03a2b
+size 2483095392

model-00052-of-00062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5ad127a151e44a0f5296ec5fc257db0abd34a645328cd4bf0b01875d61bfb80e
+size 2483095392

model-00055-of-00062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ed7d49b93d12a950e33473fee3a1b1fef3652a9409ff02319268469d5bca5398
+size 2483095392

model-00058-of-00062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:67777037bd0a08cb43f1adade2c105b083c7d3b95d1aae0390c14113b2b98d62
+size 2483095392