Instructions to use CyanMonkey/Test-Subject-3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use CyanMonkey/Test-Subject-3 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="CyanMonkey/Test-Subject-3")# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("CyanMonkey/Test-Subject-3", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use CyanMonkey/Test-Subject-3 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "CyanMonkey/Test-Subject-3" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "CyanMonkey/Test-Subject-3", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/CyanMonkey/Test-Subject-3
- SGLang
How to use CyanMonkey/Test-Subject-3 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "CyanMonkey/Test-Subject-3" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "CyanMonkey/Test-Subject-3", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "CyanMonkey/Test-Subject-3" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "CyanMonkey/Test-Subject-3", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use CyanMonkey/Test-Subject-3 with Docker Model Runner:
docker model run hf.co/CyanMonkey/Test-Subject-3
Commit History
2 days ago
-
round 14 step 7000 (24.56%)
Verified signature9b4717b -
round 13 step 6500 (22.81%)
Verified signature7baeb49 -
round 12 step 6000 (21.05%)
Verified signature5b8696f -
round 11 step 5500 (19.30%)
Verified signature259d0ba -
round 10 step 5000 (17.54%)
Verified signaturec99beb1 -
round 9 step 4500 (15.79%)
Verified signature0c58a38 -
round 8 step 4000 (14.04%)
Verified signatureed7d71f -
round 7 step 3500 (12.28%)
Verified signaturefeac368 -
round 6 step 3000 (10.53%)
Verified signaturef5b1cf9
3 days ago
-
round 5 step 2500 (8.77%)
Verified signature357ea11 -
round 4 step 2000 (7.02%)
Verified signature58d78a7 -
round 3 step 1500 (5.26%)
Verified signaturec890ded -
round 2 step 1000 (3.51%)
Verified signatureb94257e -
round 1 step 500 (1.75%)
Verified signaturea10c7e3 -
export step 6500 (22.55%)
Verified signature91a3ef9 -
export step 6000 (20.82%)
Verified signaturef6b2314 -
export step 5500 (19.08%)
Verified signature9404191 -
export step 5000 (17.35%)
Verified signature2af3242 -
export step 4500 (15.61%)
Verified signaturec2fb58f -
export step 4000 (13.88%)
Verified signatured23884a -
export step 3500 (12.14%)
Verified signature48ff242 -
export step 3000 (10.41%)
Verified signaturec45bfec -
export step 2500 (8.68%)
Verified signature5a8ba3c -
export step 2000 (6.94%)
Verified signature6b9676a -
export step 1500 (5.21%)
Verified signatureaa5938d -
export step 1000 (3.47%)
Verified signature5e2bfeb -
export step 6500 (22.55%)
Verified signature7eff596 -
export step 6000 (20.82%)
Verified signature4bd406c -
export step 5500 (19.08%)
Verified signatureffb4be2 -
export step 5000 (17.35%)
Verified signaturef84ab14 -
export step 4500 (15.61%)
Verified signature3d50783 -
export step 4000 (13.88%)
Verified signature1ed937e
4 days ago
-
export step 3500 (12.14%)
Verified signature1919e78 -
export step 3000 (10.41%)
Verified signature1273d5d -
export step 2500 (8.68%)
Verified signature1582d05 -
export step 2000 (6.94%)
Verified signature4ccfbcd -
export step 1500 (5.21%)
Verified signatured59ea09 -
export step 1000 (3.47%)
Verified signature1d459a2 -
export step 6500 (22.55%)
Verified signature2118e24 -
export step 6000 (20.82%)
Verified signature3ac3066 -
export step 5500 (19.08%)
Verified signature436007f -
export step 5000 (17.35%)
Verified signature5e4b2ed -
export step 4500 (15.61%)
Verified signature44a8845 -
export step 4000 (13.88%)
Verified signature6c3c201 -
export step 3500 (12.14%)
Verified signaturec6ee7c3 -
export step 3000 (10.41%)
Verified signature50e5b51
5 days ago
-
export step 2500 (8.68%)
Verified signature67dbe09 -
export step 2000 (6.94%)
Verified signature0bddd87 -
export step 1500 (5.21%)
Verified signaturece36ad6 -
export step 1000 (3.47%)
Verified signaturecf287ce