Quantizations of https://huggingface.co/CreitinGameplays/bloom-3b-conversational

From original readme

Specific Input Format:

The model was fine-tuned using a specific input format that goes like this:

<|system|> {system prompt} </s> <|prompter|> {user prompt} </s> <|assistant|> {model response} ```

Using this format when interacting with the model can improve its performance and generate more relevant responses.
Downloads last month
15
GGUF
Model size
4B params
Architecture
bloom
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support