duyntnet/BioMistral-7B-imatrix-GGUF

Quantizations of https://huggingface.co/BioMistral/BioMistral-7B

From original readme

BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains

2. Using BioMistral

You can use BioMistral with Hugging Face's Transformers library as follow.

Loading the model and tokenizer :

from transformers import AutoModel, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("BioMistral/BioMistral-7B")
model = AutoModel.from_pretrained("BioMistral/BioMistral-7B")