Quantizations of https://huggingface.co/euclaise/ReMask-3B
From original readme
Prompt format
The format for reddit-instruct and oasst2 was:
<|user|>
[insert instruction here]
<|assistant|>
[insert response here]
<|user|>
...
The format for TinyCoT was:
<|user|>
[insert instruction here]
<|rationale|>
[insert reasoning here]
<|answer|>
[insert direct answer here]
- Downloads last month
- 81
Hardware compatibility
Log In
to view the estimation
1-bit
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit