Transformers
English
Korean
rotary-loading
Mixture of Experts
mixture-of-experts
inference
local-llm
consumer-gpu
8gb-vram
quantization
Instructions to use myeongjun77/rotary-loading-demo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use myeongjun77/rotary-loading-demo with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("myeongjun77/rotary-loading-demo", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Welcome to the community
The community tab is the place to discuss and collaborate with the HF community!