Made it small enough to fit on my 6000
Had to quantize from gguf Didnt notice much if any quality loss
- Downloads last month
- 1
Hardware compatibility
Log In to add your hardware
3-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for IIEleven11/Behemoth-ReduX-123B-v1a-Q3_K_M
Base model
mistralai/Mistral-Large-Instruct-2407 Finetuned
TheDrummer/Behemoth-ReduX-123B-v1