| Quantization made by Richard Erkhov. | |
| [Github](https://github.com/RichardErkhov) | |
| [Discord](https://discord.gg/pvy7H8DZMG) | |
| [Request more models](https://github.com/RichardErkhov/quant_request) | |
| tiny-mixtral - bnb 8bits | |
| - Model creator: https://huggingface.co/TitanML/ | |
| - Original model: https://huggingface.co/TitanML/tiny-mixtral/ | |
| Original model description: | |
| This is a tiny-random mixtral, useful for testing and CI/CD pipelines. It is not trained at all, and not suitable for inferencing in any application. | |