Quantizations of https://huggingface.co/CreitinGameplays/bloom-3b-conversational
From original readme
Specific Input Format:
The model was fine-tuned using a specific input format that goes like this:
<|system|> {system prompt} </s> <|prompter|> {user prompt} </s> <|assistant|> {model response} ```
Using this format when interacting with the model can improve its performance and generate more relevant responses.
- Downloads last month
- 15
Hardware compatibility
Log In
to view the estimation
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit