Instructions to use nlparabic/test-aragpt with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use nlparabic/test-aragpt with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="nlparabic/test-aragpt")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("nlparabic/test-aragpt") model = AutoModelForCausalLM.from_pretrained("nlparabic/test-aragpt", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use nlparabic/test-aragpt with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "nlparabic/test-aragpt" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nlparabic/test-aragpt", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/nlparabic/test-aragpt
- SGLang
How to use nlparabic/test-aragpt with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "nlparabic/test-aragpt" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nlparabic/test-aragpt", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "nlparabic/test-aragpt" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nlparabic/test-aragpt", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use nlparabic/test-aragpt with Docker Model Runner:
docker model run hf.co/nlparabic/test-aragpt
Commit History
-
End of training
Verified signaturec5f2c1c -
Model save
Verified signaturef093fe8 -
Training in progress, step 4785
Verified signature472d31e -
Training in progress, step 4500
Verified signatureea7b3b3 -
Training in progress, step 4000
Verified signaturefd38028 -
Training in progress, step 3500
Verified signature728b97e -
Training in progress, step 3000
Verified signature1f4d5dc -
Training in progress, step 2500
Verified signature0dea64d -
Training in progress, step 2000
Verified signature25075a0 -
Training in progress, step 1500
Verified signaturef49d24b -
Training in progress, step 1000
Verified signature4f895ed -
Training in progress, step 500
Verified signaturecccca5a -
End of training
Verified signatureb4cca2d -
Model save
Verified signature35b3bdc -
Training in progress, step 319
Verified signaturebe95915 -
Model save
Verified signature4dcea1d -
Training in progress, step 319
Verified signaturec0777f0 -
Model save
Verified signature932c339 -
Training in progress, step 319
Verified signature132501f -
Model save
Verified signature2fe50db -
Training in progress, step 3190
Verified signature04170f3 -
Training in progress, step 3000
Verified signature91db93c -
Training in progress, step 2500
Verified signature46e1c2a -
Training in progress, step 2000
Verified signature29537bc -
Training in progress, step 1500
Verified signature7061e0e -
Training in progress, step 1000
Verified signature6df2ff5 -
Training in progress, step 500
Verified signature58e967d
-
Model save
Verified signature113ac02 -
Training in progress, step 3190
Verified signature7ef80b0 -
Training in progress, step 3000
Verified signature29a1c3e -
Training in progress, step 2500
Verified signaturec81e63b -
Training in progress, step 2000
Verified signature8723670 -
Training in progress, step 1500
Verified signature9d05c8f -
Training in progress, step 1000
Verified signaturee378455 -
Training in progress, step 500
Verified signature774c36b -
End of training
Verified signature1bec22c -
Model save
Verified signature368baa0 -
Training in progress, step 3190
Verified signatureef53467 -
Training in progress, step 3000
Verified signature141ecae -
Training in progress, step 2500
Verified signature1062bcb -
Training in progress, step 2000
Verified signaturea85312a -
Training in progress, step 1500
Verified signature3142a30 -
Training in progress, step 1000
Verified signaturecb0d1eb -
Training in progress, step 500
Verified signatured5534ec -
End of training
Verified signature9877acb -
Model save
Verified signatured291291 -
Training in progress, step 957
Verified signaturef0282b8 -
Training in progress, step 500
Verified signature7610371
-
End of training
Verified signature71b4635 -
Model save
Verified signature37d85a1