Instructions to use yxdu/llm-srt with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use yxdu/llm-srt with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("yxdu/llm-srt", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Rename qwen2.5-3b.pt to llm_srt_3b.pt
Verified signature888a833
-
Update README.md
Verified signature51f8724
-
Add model card (#1)
Verified signature- Add model card (7feba3f4c3e70381fcf8488d0be3d08924e1f237) Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>6bf35ec
-
Delete gemmax2-9b.pt
Verified signature1e568fb
-
Rename qwen2.5_3b.pt to qwen2.5-3b.pt
Verified signature97b043d -
Upload 2 files
Verified signatureabc30ca -
initial commit
Verified signatured5d6d7f