File size: 517 Bytes
4efb9b0 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 |
Quantization made by Richard Erkhov.
[Github](https://github.com/RichardErkhov)
[Discord](https://discord.gg/pvy7H8DZMG)
[Request more models](https://github.com/RichardErkhov/quant_request)
tiny-mixtral - bnb 4bits
- Model creator: https://huggingface.co/TitanML/
- Original model: https://huggingface.co/TitanML/tiny-mixtral/
Original model description:
This is a tiny-random mixtral, useful for testing and CI/CD pipelines. It is not trained at all, and not suitable for inferencing in any application.
|