Instructions to use yxdu/llm-srt with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use yxdu/llm-srt with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("yxdu/llm-srt", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Rename qwen2.5-3b.pt to llm_srt_3b.pt
Browse files
qwen2.5-3b.pt → llm_srt_3b.pt
RENAMED
|
File without changes
|