Instructions to use mlx-community/YandexGPTQ6 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/YandexGPTQ6 with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # if on a CUDA device, also pip install mlx[cuda] # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("mlx-community/YandexGPTQ6") prompt = "Once upon a time in" text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use mlx-community/YandexGPTQ6 with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "mlx-community/YandexGPTQ6" --prompt "Once upon a time"
Commit History
Delete YandexGPT-q6 8659714 verified
Update README.md 29eed98 verified
Troegub commited on
Upload 10 files b385229 verified
Troegub commited on
Update LICENSE 3035c7a verified
Troegub commited on
initial commit 40fae23 verified
Troegub commited on