Quantization made by Richard Erkhov.
tiny-mixtral - bnb 8bits
- Model creator: https://huggingface.co/TitanML/
- Original model: https://huggingface.co/TitanML/tiny-mixtral/
Original model description: This is a tiny-random mixtral, useful for testing and CI/CD pipelines. It is not trained at all, and not suitable for inferencing in any application.